-- Logs begin at Mon 2022-05-30 11:21:51 UTC, end at Mon 2022-05-30 12:30:38 UTC. -- May 30 11:55:08.392647 dv-cinder-840512-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 30 11:55:08.401624 dv-cinder-840512-2-iscsi devstack@n-api.service[103260]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 30 11:55:08.404430 dv-cinder-840512-2-iscsi devstack@n-api.service[103260]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 30 11:55:08 2022] *** May 30 11:55:08.404430 dv-cinder-840512-2-iscsi devstack@n-api.service[103260]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 30 11:55:08.404430 dv-cinder-840512-2-iscsi devstack@n-api.service[103260]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 30 11:55:08.404430 dv-cinder-840512-2-iscsi devstack@n-api.service[103260]: nodename: dv-cinder-840512-2-iscsi May 30 11:55:08.404430 dv-cinder-840512-2-iscsi devstack@n-api.service[103260]: machine: x86_64 May 30 11:55:08.404430 dv-cinder-840512-2-iscsi devstack@n-api.service[103260]: clock source: unix May 30 11:55:08.404430 dv-cinder-840512-2-iscsi devstack@n-api.service[103260]: pcre jit disabled May 30 11:55:08.404430 dv-cinder-840512-2-iscsi devstack@n-api.service[103260]: detected number of CPU cores: 4 May 30 11:55:08.404430 dv-cinder-840512-2-iscsi devstack@n-api.service[103260]: current working directory: / May 30 11:55:08.404430 dv-cinder-840512-2-iscsi devstack@n-api.service[103260]: detected binary path: /usr/bin/uwsgi-core May 30 11:55:08.404430 dv-cinder-840512-2-iscsi devstack@n-api.service[103260]: your processes number limit is 47680 May 30 11:55:08.405227 dv-cinder-840512-2-iscsi devstack@n-api.service[103260]: your memory page size is 4096 bytes May 30 11:55:08.405227 dv-cinder-840512-2-iscsi devstack@n-api.service[103260]: detected max file descriptor number: 2048 May 30 11:55:08.405227 dv-cinder-840512-2-iscsi devstack@n-api.service[103260]: lock engine: pthread robust mutexes May 30 11:55:08.405227 dv-cinder-840512-2-iscsi devstack@n-api.service[103260]: thunder lock: enabled May 30 11:55:08.405227 dv-cinder-840512-2-iscsi devstack@n-api.service[103260]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 30 11:55:08.405227 dv-cinder-840512-2-iscsi devstack@n-api.service[103260]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 30 11:55:08.450021 dv-cinder-840512-2-iscsi devstack@n-api.service[103260]: Python main interpreter initialized at 0x563f0be209c0 May 30 11:55:08.450021 dv-cinder-840512-2-iscsi devstack@n-api.service[103260]: python threads support enabled May 30 11:55:08.450021 dv-cinder-840512-2-iscsi devstack@n-api.service[103260]: your server socket listen backlog is limited to 100 connections May 30 11:55:08.450021 dv-cinder-840512-2-iscsi devstack@n-api.service[103260]: your mercy for graceful operations on workers is 90 seconds May 30 11:55:08.450435 dv-cinder-840512-2-iscsi devstack@n-api.service[103260]: mapped 403077 bytes (393 KB) for 2 cores May 30 11:55:08.450435 dv-cinder-840512-2-iscsi devstack@n-api.service[103260]: *** Operational MODE: preforking *** May 30 11:55:08.450712 dv-cinder-840512-2-iscsi devstack@n-api.service[103260]: *** uWSGI is running in multiple interpreter mode *** May 30 11:55:08.450712 dv-cinder-840512-2-iscsi devstack@n-api.service[103260]: spawned uWSGI master process (pid: 103260) May 30 11:55:08.450921 dv-cinder-840512-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 30 11:55:08.451768 dv-cinder-840512-2-iscsi devstack@n-api.service[103260]: spawned uWSGI worker 1 (pid: 103261, cores: 1) May 30 11:55:08.451887 dv-cinder-840512-2-iscsi devstack@n-api.service[103260]: spawned uWSGI worker 2 (pid: 103262, cores: 1) May 30 11:55:08.452110 dv-cinder-840512-2-iscsi devstack@n-api.service[103260]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 30 11:55:09.682532 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 30 11:55:09.683731 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 30 11:55:10.410462 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 30 11:55:10.410462 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: from cryptography.utils import int_from_bytes May 30 11:55:10.410901 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 30 11:55:10.410901 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: from cryptography.utils import int_from_bytes May 30 11:55:10.411117 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 30 11:55:10.411117 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: from cryptography.utils import int_from_bytes May 30 11:55:10.411334 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 30 11:55:10.411334 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: from cryptography.utils import int_from_bytes May 30 11:55:13.024330 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 30 11:55:13.024949 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 30 11:55:13.025044 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 30 11:55:13.025381 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 30 11:55:13.025459 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 30 11:55:13.025541 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 30 11:55:13.025612 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 30 11:55:13.025796 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 30 11:55:13.025994 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.026127 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 30 11:55:13.026404 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.026578 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 30 11:55:13.026735 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.026820 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.027060 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.027146 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.027396 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.027492 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.027713 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.027801 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.028042 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.028177 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.028379 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.028467 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.028705 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.028791 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.028967 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.029065 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.029286 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.029374 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.029587 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.029674 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-840512-2-iscsi {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.029905 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.029999 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.030231 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-840512-2-iscsi {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.030334 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.030545 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.030630 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.030854 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.030954 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.031164 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.031249 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.031481 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.031577 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.031789 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.031876 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.032114 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.032323 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.032472 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.032772 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.032933 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.033091 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.033267 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.033425 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.033575 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.033723 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.033863 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.034020 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.034145 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.034337 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.034469 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.034642 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.034781 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.034959 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.035103 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.035287 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.035417 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.035602 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.035732 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.036006 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-840512-2-iscsi {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.036190 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.036367 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.036465 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-840512-2-iscsi {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.036687 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.036785 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.037007 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.037095 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.037363 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.037461 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.037732 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.037827 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.038051 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.038196 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.038378 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.038487 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.038699 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.038786 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.039012 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.039109 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.039320 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.039420 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.039651 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.039741 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.039973 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.040059 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.040316 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.040408 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.040626 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.040718 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.040934 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.041019 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.041244 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.041330 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.041552 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.041658 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.042510 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.042722 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.042722 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.042891 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.042978 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.043056 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.043204 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.043305 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.043515 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.043608 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.043840 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.043926 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.044177 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.044282 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.044446 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.044533 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.044701 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.044787 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.044988 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.045083 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.045309 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.045397 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.045633 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.045732 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.045943 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.046041 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.046252 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.046350 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.046557 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.046656 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.046867 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.046952 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.047175 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.047276 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.047480 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.047574 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.047789 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.047879 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.048094 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.048278 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.048440 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.048538 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.048760 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.048852 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.049071 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.049157 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.049382 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.049476 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.049705 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.049798 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.32 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.050029 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.32 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.050113 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.32 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.050344 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.32 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.050431 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.050656 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.050742 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.050995 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.051095 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.051310 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.051404 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.051632 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.051790 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.051947 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.052036 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.052285 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.052390 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.052595 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.052682 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.052903 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.052987 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.053210 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.053307 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.053531 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.053618 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.053838 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.053932 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.054092 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.054193 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.054390 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.054496 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.054690 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.054788 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.054997 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.055083 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.055310 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.055386 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.055618 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.055701 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.055925 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.056020 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.056251 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.056381 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.056555 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.056656 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.056865 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.056951 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.057170 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.057254 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.057497 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.058173 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.058323 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.058539 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.058630 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.058937 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.059035 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.059249 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.059343 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.059563 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.059660 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.059886 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.059982 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.060215 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.060305 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.060543 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.060630 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.060852 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.060951 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.061163 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.061257 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.061472 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.061566 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.061783 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.061879 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.062093 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.062185 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.062403 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.062497 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.062713 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.062808 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.063023 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.063110 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.063333 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.063424 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.063644 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.063744 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.063953 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.064040 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.064295 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.064412 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.064607 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.064705 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.064913 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.064999 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.065225 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.065320 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.065528 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.065622 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.065837 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.065924 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.066146 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.066230 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.066454 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.066540 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.066763 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.066849 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.067067 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.067160 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.067372 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.067458 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.067677 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.067762 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.067982 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.068067 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.068308 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.068414 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.068616 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.068706 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.068919 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.069006 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.069237 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.069325 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.069546 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.069637 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.069855 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.069951 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.070161 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.070245 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.070466 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.070551 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.070786 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:13.070883 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.071125 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.071227 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.071459 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.071546 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.071793 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.071931 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.072112 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.072255 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.072471 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.072560 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.072787 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.072875 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.073128 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.073310 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.073565 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.073660 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.073888 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.073988 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.074207 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.074301 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.074526 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.074606 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.074850 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.074945 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.075175 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.075262 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.075497 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.075603 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.075820 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.075910 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.076139 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.076279 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.076489 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.076606 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.076808 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.076909 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.077127 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.077225 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.077439 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.077539 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.077760 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.077857 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.078072 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.078173 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.078400 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.078494 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.078713 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.078808 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.079055 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.079150 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.079382 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.079489 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.079709 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.079807 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.080014 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.080108 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.080361 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.080466 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.080673 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.080759 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.080983 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.081068 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.081297 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.081399 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.081621 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.081720 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.081944 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.082095 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.082261 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.082409 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.082578 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.082718 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.082890 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.083026 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.083205 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.083342 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.083514 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.083650 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.083828 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.083966 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.084143 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.084310 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.084484 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.084620 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.084801 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.084892 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.085115 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.085203 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.085429 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.085517 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.085743 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.085829 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.086057 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.086151 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.086364 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.086450 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.086674 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.086790 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.086980 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.087067 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.087283 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.087376 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.087588 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.087685 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.087900 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.087988 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.088224 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.088316 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.088549 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.088666 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.088910 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.089025 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.089225 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.089372 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.089543 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.089708 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.089855 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.090020 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.090174 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.090335 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.090484 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.090647 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.090799 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.090961 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.091113 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.091267 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.091422 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.091581 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.091750 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.091893 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.092069 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.092220 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.092406 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.092549 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.092732 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.092864 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.093043 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.093174 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.093351 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.093497 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.093668 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.093804 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.093982 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.094111 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.094300 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.094425 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.094617 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.094737 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.094931 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.095035 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.095262 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.095353 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.095582 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.095677 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.095899 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.095999 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.096267 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.096372 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.096582 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.096684 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.096907 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.097019 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.097235 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.097323 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.097539 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.097626 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.097866 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.097993 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.098172 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.098257 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.098486 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.098572 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.098790 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.098883 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.099096 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.099194 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.099401 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.099487 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.099707 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.099795 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.100014 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.100109 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.100346 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.100433 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.100650 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.100738 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.100956 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.101042 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.101259 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.101353 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.101566 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.101653 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.101871 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.101959 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.102176 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.102274 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.102483 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.102570 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.102786 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.102880 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.103092 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.103189 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.103396 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.103484 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.103742 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.103829 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.104051 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.104252 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.104930 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.105031 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.105263 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.105371 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.105582 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.105722 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.105914 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.106032 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.106229 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.106355 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.106547 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.106674 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.106861 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.106998 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.107176 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.107312 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.107494 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.107638 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.107807 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.107956 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.108128 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.108307 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.108464 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.108624 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.108787 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.108957 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.109109 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.109273 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.109422 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.109599 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.109737 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.109909 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.110059 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.110229 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.110375 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.110578 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.110723 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.110918 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.111070 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.111225 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.111362 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.111554 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.111691 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.111868 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.112018 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.112211 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.112343 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.112507 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.112597 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.112819 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.112906 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.113129 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.113216 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.113439 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.113532 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.113753 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.113850 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.114065 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.114153 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.114374 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.114459 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.114690 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.114788 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.115002 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.115107 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.115319 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.115415 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.115626 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.115735 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.115937 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.116041 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.116261 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.116370 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.116577 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.116682 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.116903 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.116998 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.117222 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.117316 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.117540 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.117644 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.117851 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.117945 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.118166 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.118259 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.118475 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.118570 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.118786 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.118882 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.119092 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.119186 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.119395 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.119490 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.119700 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.119796 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.120052 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.120175 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.120393 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.120592 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.120814 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.120909 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.121130 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.121228 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.121437 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.121534 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.121754 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.121857 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.122066 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.122170 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.122374 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.122471 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.122680 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.122776 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.122996 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.123096 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.123314 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.123399 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.123628 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.123730 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.123952 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.124048 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.124284 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.124386 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.124596 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.124684 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.124901 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.124996 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.125223 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.125316 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.125531 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.125618 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.125835 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.125928 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.126140 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.126233 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.126452 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.126540 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.126787 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.126880 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.127097 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.127187 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.127403 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.127497 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.127722 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.127811 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.128033 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.128118 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.128368 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.128455 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.128686 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.128775 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.128998 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.129082 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.129309 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.129415 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.129628 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.129713 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.129940 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.130025 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.130251 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.130347 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.130562 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.130655 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.130873 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.130960 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.131185 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.131279 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.131496 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.131582 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.131811 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.131897 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.132121 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.132245 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.132454 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.132542 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.132759 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.132844 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.133063 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.133149 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.133375 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.133469 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.133693 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.133952 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.134261 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.134411 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.134598 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.134693 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.134919 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.135004 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.135237 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.135324 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.135559 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.136150 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.136534 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.136637 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.136872 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.136960 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.137225 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.137313 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.137540 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.137635 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.137856 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.137956 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.138170 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.138260 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.138477 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.138563 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.138785 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.138872 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.139095 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.139189 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.139400 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.139485 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.139971 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.140070 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.140301 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.140392 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.140610 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.140706 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.140915 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.141015 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.141222 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.141310 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.141529 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.141616 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.141837 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.141936 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.142142 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.142228 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.142447 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.142533 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.142755 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.142857 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.143060 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.143147 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.143383 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.143470 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.143692 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.143788 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.143995 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.144081 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.144329 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.144420 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.144637 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.144725 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.144974 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.145065 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.145280 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.145402 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.145619 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.145708 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.145948 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.146042 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.146264 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.146350 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.146574 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.146663 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.146879 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.146965 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.147199 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.147284 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.147507 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.147596 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.147810 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.147897 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.148112 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.148232 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.148446 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.148568 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.148751 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.148844 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.149052 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.149147 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.149363 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.149484 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.149674 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.149761 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.149982 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.150077 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.150288 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.150374 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.150591 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.150676 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.150897 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.150995 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.151201 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.151336 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.151575 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.151685 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.151883 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.151972 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.152209 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.152430 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.152522 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.152737 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.152837 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.153051 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.153138 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.153361 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.153447 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.153668 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.153779 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.153978 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.154068 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.154284 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.154381 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.154598 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.154696 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.154901 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.154987 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.155206 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.155300 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.155512 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.155604 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.155818 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.155908 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.156124 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.156225 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.156452 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.156541 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.156768 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.156852 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.157077 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.157163 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.157381 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.157514 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.157686 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.157780 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.157994 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.158080 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.158320 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.158456 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.158602 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.158691 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.158911 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.159074 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.159221 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.159314 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.159533 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.159621 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.159838 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.159939 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.160142 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.160262 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.160477 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.160574 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.160789 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.160889 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.161103 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.161190 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.161410 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.161496 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.161710 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.161807 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.162015 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.162100 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.162317 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.162403 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.162624 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.162730 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.162929 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.163018 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.163232 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.163324 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.163540 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.163628 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.163844 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.163939 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.164148 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.164268 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.164476 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.164564 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.164823 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.164945 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.165132 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.165235 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.165453 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.165558 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.165776 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.165882 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.166088 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.166193 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.166402 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.166504 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.166713 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.166808 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.167545 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.167656 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.167978 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.168064 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.168321 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.168412 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.168641 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.168778 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.168955 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.169042 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.169269 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.169356 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.169574 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.169707 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.169880 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.169968 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.170202 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.170288 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.170516 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.170612 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.170827 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.170914 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.171147 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.171234 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.171454 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.171540 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.171775 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.171862 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.172078 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.172179 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.172411 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.172507 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.172721 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.172818 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.173030 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.173133 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.173338 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.173427 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.173645 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.173732 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.173956 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.174048 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.174267 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.174354 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.174578 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.174664 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.174887 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.174983 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.175197 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.175283 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.175505 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.175591 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.175810 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.175903 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.176116 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.176241 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.176484 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.176623 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.176760 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.176855 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.177069 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.177165 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.177375 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.177460 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.177683 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.177777 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.177988 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.178074 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.178303 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.178425 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.178609 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.178743 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.179041 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.179138 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.179354 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.179439 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.179664 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.179794 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.179971 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.180065 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.180306 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.180397 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.180624 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.180712 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.180930 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.181022 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.181247 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.181354 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.181553 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.181679 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.181975 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.182062 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.182294 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.182392 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.182651 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.182744 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.182978 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.183089 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.183283 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.183388 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.183588 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.183696 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.183899 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.183987 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.184252 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.184359 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.184564 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.184654 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.184872 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.184960 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.185177 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.185274 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.185502 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.185597 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.185808 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.185925 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.186131 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.186245 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.186554 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.186641 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.186869 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.186963 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.187177 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.187266 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.187577 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.187663 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.187899 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.187997 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.188235 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.188340 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.188564 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.188652 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.188877 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.189047 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.189196 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.189304 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.189503 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.189592 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.189823 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.189992 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.190134 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.190272 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.190448 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.190587 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.190764 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.190909 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.191074 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.191221 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.191388 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.191525 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.191695 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.191835 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.192020 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.192207 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.192368 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.192515 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.192684 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.192842 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.193009 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.193155 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.193406 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.193549 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.193733 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.193872 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.194045 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.194182 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.194363 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.194496 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.194674 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.194833 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.194982 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.195117 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.195276 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.195415 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.195585 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.195721 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.195892 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.196029 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.197186 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.197282 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.197362 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.197441 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.197535 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.197631 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.197631 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.198077 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.198782 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.199036 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.199155 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.199295 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.199421 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.199556 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.199740 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.199870 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.200076 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.200219 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.200438 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.200531 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.200770 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.200932 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.201100 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.201194 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.201415 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.201502 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.201747 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.201842 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.202069 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.202156 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.202382 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.202477 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.202700 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.202795 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.203011 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.203104 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.203323 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.203411 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.203635 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.203732 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.203976 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.204061 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.204309 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.204401 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.204636 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.204725 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.204966 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.205052 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.205298 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.205384 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.205615 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.205702 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.205936 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.206059 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.206263 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.206372 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.206578 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.206675 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.206888 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.206975 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.207198 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.207295 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.207508 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.207595 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.207813 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.207898 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.208125 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.208256 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.208452 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.208549 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.208758 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.208848 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.209071 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.209187 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.209378 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.209464 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.209679 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.209765 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.209986 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.210120 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.210291 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.210385 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.210615 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.210712 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.210923 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.211011 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.211229 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.211315 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.211539 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.211627 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.211842 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.211929 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.212191 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.212294 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.212474 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.212563 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.212818 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.212907 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.213125 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.213213 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.213553 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.213663 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.213812 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.213911 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.214137 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.214229 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.214463 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.214559 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.214773 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.214861 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.215096 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.215181 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.215413 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.215509 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.215730 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.215816 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.216047 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.216133 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.216398 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.216504 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.216716 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.216802 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.217029 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.217115 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.217343 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.217439 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.217654 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.217771 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.217970 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.218059 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.218287 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.218514 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.218611 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.218855 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.219143 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.219295 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.219476 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.219614 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.219788 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.219881 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.220101 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.220282 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.220442 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.220532 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.220763 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.220890 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.221071 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.221168 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.221386 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.221483 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.221695 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.221784 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.222006 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.222104 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.222320 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.222420 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.222650 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.222801 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.222977 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.223143 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.223295 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.223391 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.223654 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.223782 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.223917 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.224007 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.224259 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.224350 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.224576 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.224664 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.224894 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.224983 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.225227 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.225313 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.225546 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.225651 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.225852 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.225939 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.226168 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.226254 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.226482 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.226576 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.226795 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.226881 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.227110 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.227195 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.227421 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.227522 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.227733 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.227821 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.228044 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.228131 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.228381 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.228480 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.228693 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.228788 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.229013 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.229100 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.229328 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.229922 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.230172 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.230265 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.230501 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.230612 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.230814 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.230913 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.231136 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.231223 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.231448 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.231670 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.231758 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.231992 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.232303 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.232399 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.232625 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.232724 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.232959 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.233047 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.233290 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.233385 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.233619 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.233716 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.233943 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.234038 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.234251 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.234347 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.234561 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.234657 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.234874 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.234960 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.235181 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.235269 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.235485 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.235572 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.235797 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.235888 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.236102 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.236204 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.236446 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.236543 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.236761 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.236857 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.237071 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.237158 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.237389 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.237605 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.237702 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.237960 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.238222 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.238318 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.238582 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.238669 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.238913 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.239010 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.239232 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.239326 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.239546 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.239641 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.239874 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.239976 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.240219 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.240319 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.240509 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.240600 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.240818 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.240904 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.241130 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.241226 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.241435 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.241529 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.241746 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.241841 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.242051 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.242139 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.242359 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.242454 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.242665 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.242751 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.242976 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.243063 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.243279 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.243365 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.243591 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.243677 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.243898 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.243986 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.244227 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.244317 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.244537 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.244625 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.244844 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.244931 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.245198 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.245288 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.245507 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.245604 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.245812 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.245943 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.246118 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.246204 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.246422 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.246518 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.246728 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.246824 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.247039 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.247125 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.247343 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.247437 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.247654 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.247741 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.247959 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.248051 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.248297 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.248399 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.248604 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.248694 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.248919 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.249006 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.249264 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.249352 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.249572 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.249658 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.249886 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.249971 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.250192 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.250281 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.250509 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.250596 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.250821 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.250916 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.251134 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.251220 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.251450 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.251543 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.251765 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.251865 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.252112 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.252341 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.252455 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.252683 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.252991 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.253091 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.253330 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.253417 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.253656 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.253750 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.253968 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.254067 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.254279 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.254367 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.254590 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.254678 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.254903 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.254997 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.255210 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.255297 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.255523 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.255615 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.255834 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.255928 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.256145 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.256252 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.256478 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.256563 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.256792 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.256881 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.257102 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.257188 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.257412 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.257498 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.257723 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.257811 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.258035 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.258121 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.258346 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.258430 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.258654 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.258794 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.258965 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.259051 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.259274 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.259375 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.259585 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.259715 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.259901 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.259989 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.260261 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.260467 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.261121 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.261273 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.261449 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.261533 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.261742 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.261854 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.262061 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.262149 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.262373 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.262469 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.262684 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.262771 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.262994 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.263080 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.263304 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.263398 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.263622 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.263710 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.263932 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.264017 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.264284 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.264392 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.264594 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.264951 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.265272 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.265359 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.265593 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.265687 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.265906 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.265991 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.266227 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.266323 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.266541 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.266641 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.266859 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.266944 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.267186 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.267299 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.267500 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.267594 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.267821 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.267908 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.268136 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.268285 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.268498 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.268588 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.268828 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.268913 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.269141 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.269227 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.269453 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.269540 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.269762 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.269849 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.270067 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.270153 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.270374 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.270463 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.270683 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.270769 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.271035 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.271123 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.271279 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.271369 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.271591 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.271676 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.271896 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.272000 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.272228 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.272330 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.272535 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.272621 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.272835 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.272931 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.273139 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.273226 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.273441 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.273527 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.273748 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.273843 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.274050 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.274137 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.274400 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.274506 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.274653 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.274749 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.274957 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.275043 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.275258 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.275344 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.275562 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.275649 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.275868 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.275955 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.276181 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.276311 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.276569 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.276677 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.276927 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.277018 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.277233 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.277327 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.277537 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.277658 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.277872 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.277985 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.278212 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.278299 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.278533 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.278622 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.278860 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.278995 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.279176 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.279274 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.279506 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.279593 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.279820 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.279908 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.280145 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.280273 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.280495 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.280582 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.280816 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.280904 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.281130 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.281229 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.281447 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.281533 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.281768 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.281872 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.282080 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.282179 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.282393 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.282480 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.282707 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.282792 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.283018 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.283105 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.283330 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.283424 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.283657 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.283744 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.283982 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.284070 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.284315 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.284405 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.284644 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.284731 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.284963 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.285051 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.285279 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.285364 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.285600 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.285730 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.285915 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.286019 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.286232 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.286323 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.286544 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.286641 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.286855 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.286945 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.287172 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.287259 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.287483 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.287579 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.287796 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.287886 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.288116 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.288224 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.288458 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.288548 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.288778 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.288865 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.289108 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.289207 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.289427 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.289518 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.289756 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.289844 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.290081 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.290186 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.290427 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.290517 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.290742 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.290830 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.291065 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.291160 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.291385 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.291472 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.291695 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.291781 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.292533 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 30 11:55:13.292649 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.292836 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:13.293079 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 30 11:55:13.351229 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: INFO dbcounter [None req-2c2f298b-a202-47cf-bf26-b80aa0b912e2 None None] Registered counter for database nova_api May 30 11:55:13.351405 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: INFO dbcounter [None req-3be192f1-466a-4df3-a19e-22ee78e3ac61 None None] Registered counter for database nova_api May 30 11:55:13.373341 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG oslo_db.sqlalchemy.engines [None req-3be192f1-466a-4df3-a19e-22ee78e3ac61 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103261) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 30 11:55:13.375027 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG oslo_db.sqlalchemy.engines [None req-2c2f298b-a202-47cf-bf26-b80aa0b912e2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103262) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 30 11:55:13.380848 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG dbcounter [-] [103261] Writer thread running {{(pid=103261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 30 11:55:13.382349 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG dbcounter [-] [103262] Writer thread running {{(pid=103262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 30 11:55:13.440465 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.context [None req-2c2f298b-a202-47cf-bf26-b80aa0b912e2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),aeb16e79-014c-4213-8687-12281f6933dc(cell1) {{(pid=103262) load_cells /opt/stack/nova/nova/context.py:464}} May 30 11:55:13.443229 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.context [None req-3be192f1-466a-4df3-a19e-22ee78e3ac61 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),aeb16e79-014c-4213-8687-12281f6933dc(cell1) {{(pid=103261) load_cells /opt/stack/nova/nova/context.py:464}} May 30 11:55:13.444620 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG oslo_concurrency.lockutils [None req-2c2f298b-a202-47cf-bf26-b80aa0b912e2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 11:55:13.446207 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG oslo_concurrency.lockutils [None req-2c2f298b-a202-47cf-bf26-b80aa0b912e2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 11:55:13.446995 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG oslo_concurrency.lockutils [None req-2c2f298b-a202-47cf-bf26-b80aa0b912e2 None None] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 11:55:13.447342 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG oslo_concurrency.lockutils [None req-3be192f1-466a-4df3-a19e-22ee78e3ac61 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 11:55:13.449220 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG oslo_concurrency.lockutils [None req-3be192f1-466a-4df3-a19e-22ee78e3ac61 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 11:55:13.449342 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG oslo_concurrency.lockutils [None req-2c2f298b-a202-47cf-bf26-b80aa0b912e2 None None] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 11:55:13.450003 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG oslo_concurrency.lockutils [None req-3be192f1-466a-4df3-a19e-22ee78e3ac61 None None] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 11:55:13.451219 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: INFO dbcounter [None req-2c2f298b-a202-47cf-bf26-b80aa0b912e2 None None] Registered counter for database nova_cell0 May 30 11:55:13.451980 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG oslo_concurrency.lockutils [None req-3be192f1-466a-4df3-a19e-22ee78e3ac61 None None] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 11:55:13.454070 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: INFO dbcounter [None req-3be192f1-466a-4df3-a19e-22ee78e3ac61 None None] Registered counter for database nova_cell0 May 30 11:55:13.455251 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: INFO dbcounter [None req-2c2f298b-a202-47cf-bf26-b80aa0b912e2 None None] Registered counter for database nova_cell1 May 30 11:55:13.458033 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: INFO dbcounter [None req-3be192f1-466a-4df3-a19e-22ee78e3ac61 None None] Registered counter for database nova_cell1 May 30 11:55:13.462283 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG oslo_db.sqlalchemy.engines [None req-2c2f298b-a202-47cf-bf26-b80aa0b912e2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103262) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 30 11:55:13.465021 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG oslo_db.sqlalchemy.engines [None req-2c2f298b-a202-47cf-bf26-b80aa0b912e2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103262) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 30 11:55:13.466240 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG oslo_db.sqlalchemy.engines [None req-3be192f1-466a-4df3-a19e-22ee78e3ac61 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103261) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 30 11:55:13.467838 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG oslo_db.sqlalchemy.engines [None req-3be192f1-466a-4df3-a19e-22ee78e3ac61 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103261) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 30 11:55:13.470631 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG dbcounter [-] [103262] Writer thread running {{(pid=103262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 30 11:55:13.473732 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG dbcounter [-] [103261] Writer thread running {{(pid=103261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 30 11:55:13.475720 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG dbcounter [-] [103261] Writer thread running {{(pid=103261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 30 11:55:13.612690 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG dbcounter [-] [103262] Writer thread running {{(pid=103262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 30 11:55:13.623107 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: INFO dbcounter [None req-2c2f298b-a202-47cf-bf26-b80aa0b912e2 None None] Registered counter for database nova_cell0 May 30 11:55:13.626253 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: INFO dbcounter [None req-3be192f1-466a-4df3-a19e-22ee78e3ac61 None None] Registered counter for database nova_cell0 May 30 11:55:13.633301 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG oslo_db.sqlalchemy.engines [None req-2c2f298b-a202-47cf-bf26-b80aa0b912e2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103262) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 30 11:55:13.638105 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG oslo_db.sqlalchemy.engines [None req-3be192f1-466a-4df3-a19e-22ee78e3ac61 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103261) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 30 11:55:13.638690 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG dbcounter [-] [103262] Writer thread running {{(pid=103262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 30 11:55:13.642762 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG dbcounter [-] [103261] Writer thread running {{(pid=103261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 30 11:55:14.098401 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: WARNING keystonemiddleware.auth_token [None req-2c2f298b-a202-47cf-bf26-b80aa0b912e2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 30 11:55:14.106063 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: WARNING keystonemiddleware.auth_token [None req-2c2f298b-a202-47cf-bf26-b80aa0b912e2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 30 11:55:14.128081 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: WARNING keystonemiddleware.auth_token [None req-3be192f1-466a-4df3-a19e-22ee78e3ac61 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 30 11:55:14.135416 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: WARNING keystonemiddleware.auth_token [None req-3be192f1-466a-4df3-a19e-22ee78e3ac61 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 30 11:55:14.336927 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: WARNING keystonemiddleware.auth_token [None req-2c2f298b-a202-47cf-bf26-b80aa0b912e2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 30 11:55:14.343456 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: WARNING keystonemiddleware.auth_token [None req-2c2f298b-a202-47cf-bf26-b80aa0b912e2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 30 11:55:14.348709 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563f0be209c0 pid: 103262 (default app) May 30 11:55:14.350995 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi [None req-2c2f298b-a202-47cf-bf26-b80aa0b912e2 None None] Calling method '>' {{(pid=103262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 11:55:14.352190 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: INFO nova.api.openstack.requestlog [None req-2c2f298b-a202-47cf-bf26-b80aa0b912e2 None None] 10.222.0.32 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001971 May 30 11:55:14.352622 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: [pid: 103262|app: 0|req: 1/1] 10.222.0.32 () {50 vars in 788 bytes} [Mon May 30 11:55:14 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 11:55:14.411169 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: WARNING keystonemiddleware.auth_token [None req-3be192f1-466a-4df3-a19e-22ee78e3ac61 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 30 11:55:14.417448 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: WARNING keystonemiddleware.auth_token [None req-3be192f1-466a-4df3-a19e-22ee78e3ac61 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 30 11:55:14.422609 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563f0be209c0 pid: 103261 (default app) May 30 11:56:34.600517 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi [None req-2c2f298b-a202-47cf-bf26-b80aa0b912e2 None None] Calling method '>' {{(pid=103262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 11:56:34.601529 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: INFO nova.api.openstack.requestlog [None req-2c2f298b-a202-47cf-bf26-b80aa0b912e2 None None] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 May 30 11:56:34.602099 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: [pid: 103262|app: 0|req: 2/2] 10.222.0.32 () {54 vars in 930 bytes} [Mon May 30 11:56:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 11:56:34.616106 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG dbcounter [-] [103261] Writing DB stats nova_api:SELECT=3 {{(pid=103261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:34.617066 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG dbcounter [-] [103261] Writing DB stats nova_cell1:SELECT=3 {{(pid=103261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:34.618005 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG dbcounter [-] [103261] Writing DB stats nova_cell0:SELECT=3 {{(pid=103261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:34.618848 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG dbcounter [-] [103261] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:35.078165 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-7cc54316-fb16-49aa-bb31-f99e320d07cd admin admin] Calling method '>' {{(pid=103261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 11:56:35.107265 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: INFO nova.api.openstack.requestlog [None req-7cc54316-fb16-49aa-bb31-f99e320d07cd admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.496769 May 30 11:56:35.108011 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: [pid: 103261|app: 0|req: 1/3] 10.222.0.32 () {60 vars in 1291 bytes} [Mon May 30 11:56:34 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 11:56:37.479382 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi [None req-2c2f298b-a202-47cf-bf26-b80aa0b912e2 None None] Calling method '>' {{(pid=103262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 11:56:37.480316 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: INFO nova.api.openstack.requestlog [None req-2c2f298b-a202-47cf-bf26-b80aa0b912e2 None None] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001934 May 30 11:56:37.480721 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: [pid: 103262|app: 0|req: 3/4] 10.222.0.32 () {54 vars in 930 bytes} [Mon May 30 11:56:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 11:56:37.541480 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-700c2d4a-0cbd-4bfe-96b8-5500e9f62fff admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "ram": 256, "name": "cirros256", "id": "c1", "vcpus": 1, "rxtx_factor": 1.0}} {{(pid=103261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 11:56:37.559751 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 30 11:56:37.559751 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: warnings.warn(msg) May 30 11:56:37.589493 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: INFO nova.api.openstack.requestlog [None req-700c2d4a-0cbd-4bfe-96b8-5500e9f62fff admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.102148 May 30 11:56:37.590466 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: [pid: 103261|app: 0|req: 2/5] 10.222.0.32 () {64 vars in 1282 bytes} [Mon May 30 11:56:37 2022] POST /compute/v2.1/flavors => generated 407 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 30 11:56:37.607170 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG dbcounter [-] [103262] Writing DB stats nova_api:SELECT=3 {{(pid=103262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:37.607960 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG dbcounter [-] [103262] Writing DB stats nova_cell0:SELECT=3 {{(pid=103262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:37.608992 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG dbcounter [-] [103262] Writing DB stats nova_cell1:SELECT=3 {{(pid=103262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:37.609715 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG dbcounter [-] [103262] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:37.816723 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi [None req-5b5fc08e-d729-4cc5-8db2-b7e4333f8ee8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 11:56:37.819207 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 30 11:56:37.819207 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: warnings.warn(msg) May 30 11:56:37.898183 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: INFO nova.api.openstack.requestlog [None req-5b5fc08e-d729-4cc5-8db2-b7e4333f8ee8 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.296013 May 30 11:56:37.899592 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: [pid: 103262|app: 0|req: 4/6] 10.222.0.32 () {64 vars in 1335 bytes} [Mon May 30 11:56:37 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 11:56:40.301247 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-700c2d4a-0cbd-4bfe-96b8-5500e9f62fff admin admin] Calling method '>' {{(pid=103261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 11:56:40.302966 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: INFO nova.api.openstack.requestlog [None req-700c2d4a-0cbd-4bfe-96b8-5500e9f62fff admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002206 May 30 11:56:40.303898 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: [pid: 103261|app: 0|req: 3/7] 10.222.0.32 () {54 vars in 930 bytes} [Mon May 30 11:56:40 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 11:56:40.412916 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi [None req-c228dc16-525a-4459-9373-6d19a7b24020 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d1", "disk": 5, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "os-flavor-access:is_public": true, "name": "ds512M"}} {{(pid=103262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 11:56:40.431124 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 30 11:56:40.431124 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: warnings.warn(msg) May 30 11:56:40.450535 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: INFO nova.api.openstack.requestlog [None req-c228dc16-525a-4459-9373-6d19a7b24020 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.139354 May 30 11:56:40.451095 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: [pid: 103262|app: 0|req: 5/8] 10.222.0.32 () {64 vars in 1282 bytes} [Mon May 30 11:56:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 30 11:56:40.462817 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-161ecb0d-1de4-4883-8413-f4f0d51fa236 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 11:56:40.464948 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 30 11:56:40.464948 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: warnings.warn(msg) May 30 11:56:40.498513 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: INFO nova.api.openstack.requestlog [None req-161ecb0d-1de4-4883-8413-f4f0d51fa236 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039158 May 30 11:56:40.498986 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: [pid: 103261|app: 0|req: 4/9] 10.222.0.32 () {64 vars in 1335 bytes} [Mon May 30 11:56:40 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 11:56:42.838111 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi [None req-c228dc16-525a-4459-9373-6d19a7b24020 admin admin] Calling method '>' {{(pid=103262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 11:56:42.839667 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: INFO nova.api.openstack.requestlog [None req-c228dc16-525a-4459-9373-6d19a7b24020 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002020 May 30 11:56:42.840319 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: [pid: 103262|app: 0|req: 6/10] 10.222.0.32 () {54 vars in 930 bytes} [Mon May 30 11:56:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 11:56:42.904204 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-49ea24bc-3bd3-45d4-85bc-b12dab662070 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "swap": 0, "disk": 10, "id": "d2", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 1024, "os-flavor-access:is_public": true}} {{(pid=103261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 11:56:42.925077 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: INFO nova.api.openstack.requestlog [None req-49ea24bc-3bd3-45d4-85bc-b12dab662070 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.078716 May 30 11:56:42.925907 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: [pid: 103261|app: 0|req: 5/11] 10.222.0.32 () {64 vars in 1282 bytes} [Mon May 30 11:56:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 30 11:56:42.938477 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi [None req-9d77ca33-ce22-4840-bc4f-1bdd15ac752b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 11:56:42.962903 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: INFO nova.api.openstack.requestlog [None req-9d77ca33-ce22-4840-bc4f-1bdd15ac752b admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028051 May 30 11:56:42.963743 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: [pid: 103262|app: 0|req: 7/12] 10.222.0.32 () {64 vars in 1335 bytes} [Mon May 30 11:56:42 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 11:56:45.319403 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-49ea24bc-3bd3-45d4-85bc-b12dab662070 admin admin] Calling method '>' {{(pid=103261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 11:56:45.320500 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: INFO nova.api.openstack.requestlog [None req-49ea24bc-3bd3-45d4-85bc-b12dab662070 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 May 30 11:56:45.320898 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: [pid: 103261|app: 0|req: 6/13] 10.222.0.32 () {54 vars in 930 bytes} [Mon May 30 11:56:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 11:56:45.387554 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi [None req-1fd8e4e5-5646-4fb7-b7ed-2994da5bb9de admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "vcpus": 2, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "ram": 2048, "name": "ds2G", "id": "d3"}} {{(pid=103262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 11:56:45.407202 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: INFO nova.api.openstack.requestlog [None req-1fd8e4e5-5646-4fb7-b7ed-2994da5bb9de admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.079553 May 30 11:56:45.407951 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: [pid: 103262|app: 0|req: 8/14] 10.222.0.32 () {64 vars in 1282 bytes} [Mon May 30 11:56:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 30 11:56:45.420353 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-c15fe50d-2ca0-42d2-a7b1-fb4357c31e26 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 11:56:45.446203 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: INFO nova.api.openstack.requestlog [None req-c15fe50d-2ca0-42d2-a7b1-fb4357c31e26 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030041 May 30 11:56:45.446792 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: [pid: 103261|app: 0|req: 7/15] 10.222.0.32 () {64 vars in 1335 bytes} [Mon May 30 11:56:45 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 11:56:47.805008 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi [None req-1fd8e4e5-5646-4fb7-b7ed-2994da5bb9de admin admin] Calling method '>' {{(pid=103262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 11:56:47.806145 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: INFO nova.api.openstack.requestlog [None req-1fd8e4e5-5646-4fb7-b7ed-2994da5bb9de admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 May 30 11:56:47.806549 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: [pid: 103262|app: 0|req: 9/16] 10.222.0.32 () {54 vars in 930 bytes} [Mon May 30 11:56:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 11:56:47.868476 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-f31459d1-f154-4f37-a55b-997e9ca70c58 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "swap": 0, "disk": 20, "vcpus": 4, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=103261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 11:56:47.894881 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: INFO nova.api.openstack.requestlog [None req-f31459d1-f154-4f37-a55b-997e9ca70c58 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.081910 May 30 11:56:47.902759 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: [pid: 103261|app: 0|req: 8/17] 10.222.0.32 () {64 vars in 1282 bytes} [Mon May 30 11:56:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 30 11:56:47.908102 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi [None req-6893b72b-0a79-47bd-ab59-c795c9c752f4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 11:56:47.934851 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: INFO nova.api.openstack.requestlog [None req-6893b72b-0a79-47bd-ab59-c795c9c752f4 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030421 May 30 11:56:47.938567 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: [pid: 103262|app: 0|req: 10/18] 10.222.0.32 () {64 vars in 1335 bytes} [Mon May 30 11:56:47 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 11:56:50.275857 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-f31459d1-f154-4f37-a55b-997e9ca70c58 admin admin] Calling method '>' {{(pid=103261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 11:56:50.276902 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: INFO nova.api.openstack.requestlog [None req-f31459d1-f154-4f37-a55b-997e9ca70c58 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001525 May 30 11:56:50.277512 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: [pid: 103261|app: 0|req: 9/19] 10.222.0.32 () {54 vars in 930 bytes} [Mon May 30 11:56:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 11:56:50.350718 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi [None req-61b2dcc8-7d4d-485a-b943-360035c5d004 admin admin] Calling method '>' {{(pid=103262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 11:56:50.377003 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: INFO nova.api.openstack.requestlog [None req-61b2dcc8-7d4d-485a-b943-360035c5d004 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.092913 May 30 11:56:50.377885 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: [pid: 103262|app: 0|req: 11/20] 10.222.0.32 () {60 vars in 1291 bytes} [Mon May 30 11:56:50 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 11:56:52.915476 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-f31459d1-f154-4f37-a55b-997e9ca70c58 admin admin] Calling method '>' {{(pid=103261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 11:56:52.917500 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: INFO nova.api.openstack.requestlog [None req-f31459d1-f154-4f37-a55b-997e9ca70c58 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001543 May 30 11:56:52.917948 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: [pid: 103261|app: 0|req: 10/21] 10.222.0.32 () {54 vars in 930 bytes} [Mon May 30 11:56:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 11:56:52.979580 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi [None req-59f61682-f35c-41ea-8bc5-fea30544853a admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "ram": 512, "id": "1", "name": "m1.tiny", "disk": 1}} {{(pid=103262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 11:56:52.997808 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: INFO nova.api.openstack.requestlog [None req-59f61682-f35c-41ea-8bc5-fea30544853a admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.073531 May 30 11:56:52.998415 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: [pid: 103262|app: 0|req: 12/22] 10.222.0.32 () {64 vars in 1282 bytes} [Mon May 30 11:56:52 2022] POST /compute/v2.1/flavors => generated 402 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 30 11:56:53.011656 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-eb42454b-4a06-421c-80db-353d3d455980 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 11:56:53.038238 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: INFO nova.api.openstack.requestlog [None req-eb42454b-4a06-421c-80db-353d3d455980 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030624 May 30 11:56:53.038889 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: [pid: 103261|app: 0|req: 11/23] 10.222.0.32 () {64 vars in 1332 bytes} [Mon May 30 11:56:53 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 11:56:55.520277 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi [None req-59f61682-f35c-41ea-8bc5-fea30544853a admin admin] Calling method '>' {{(pid=103262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 11:56:55.521300 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: INFO nova.api.openstack.requestlog [None req-59f61682-f35c-41ea-8bc5-fea30544853a admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001533 May 30 11:56:55.521707 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: [pid: 103262|app: 0|req: 13/24] 10.222.0.32 () {54 vars in 930 bytes} [Mon May 30 11:56:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 11:56:55.587722 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-4859431c-6a7e-4f24-bf02-b5a587773697 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "os-flavor-access:is_public": true, "disk": 20, "id": "2", "rxtx_factor": 1.0, "vcpus": 1, "name": "m1.small", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 11:56:55.606298 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: INFO nova.api.openstack.requestlog [None req-4859431c-6a7e-4f24-bf02-b5a587773697 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.078210 May 30 11:56:55.606854 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: [pid: 103261|app: 0|req: 12/25] 10.222.0.32 () {64 vars in 1282 bytes} [Mon May 30 11:56:55 2022] POST /compute/v2.1/flavors => generated 405 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 30 11:56:55.618752 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi [None req-eea01386-547b-48d9-b871-dda562089622 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 11:56:55.642117 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: INFO nova.api.openstack.requestlog [None req-eea01386-547b-48d9-b871-dda562089622 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026883 May 30 11:56:55.642707 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: [pid: 103262|app: 0|req: 14/26] 10.222.0.32 () {64 vars in 1332 bytes} [Mon May 30 11:56:55 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 11:56:58.029570 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-4859431c-6a7e-4f24-bf02-b5a587773697 admin admin] Calling method '>' {{(pid=103261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 11:56:58.030597 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: INFO nova.api.openstack.requestlog [None req-4859431c-6a7e-4f24-bf02-b5a587773697 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 May 30 11:56:58.031000 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: [pid: 103261|app: 0|req: 13/27] 10.222.0.32 () {54 vars in 930 bytes} [Mon May 30 11:56:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 11:56:58.091394 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi [None req-2069e3ea-4753-479e-89a8-2d998ffa6fee admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "os-flavor-access:is_public": true, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.medium", "id": "3", "rxtx_factor": 1.0, "vcpus": 2}} {{(pid=103262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 11:56:58.112775 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: INFO nova.api.openstack.requestlog [None req-2069e3ea-4753-479e-89a8-2d998ffa6fee admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.075855 May 30 11:56:58.113339 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: [pid: 103262|app: 0|req: 15/28] 10.222.0.32 () {64 vars in 1282 bytes} [Mon May 30 11:56:58 2022] POST /compute/v2.1/flavors => generated 406 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 30 11:56:58.126082 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-e5c5f893-fefe-4e75-a24b-857daa2a24f9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 11:56:58.149690 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: INFO nova.api.openstack.requestlog [None req-e5c5f893-fefe-4e75-a24b-857daa2a24f9 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027252 May 30 11:56:58.150553 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: [pid: 103261|app: 0|req: 14/29] 10.222.0.32 () {64 vars in 1332 bytes} [Mon May 30 11:56:58 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 11:57:00.506652 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi [None req-2069e3ea-4753-479e-89a8-2d998ffa6fee admin admin] Calling method '>' {{(pid=103262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 11:57:00.509135 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: INFO nova.api.openstack.requestlog [None req-2069e3ea-4753-479e-89a8-2d998ffa6fee admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002928 May 30 11:57:00.509709 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: [pid: 103262|app: 0|req: 16/30] 10.222.0.32 () {54 vars in 930 bytes} [Mon May 30 11:57:00 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 30 11:57:00.579812 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-84dd391e-dc52-41b9-81bc-60b96cd0ad3b admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 8192, "name": "m1.large", "swap": 0, "vcpus": 4, "id": "4", "os-flavor-access:is_public": true}} {{(pid=103261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 11:57:00.598236 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: INFO nova.api.openstack.requestlog [None req-84dd391e-dc52-41b9-81bc-60b96cd0ad3b admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.080836 May 30 11:57:00.598793 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: [pid: 103261|app: 0|req: 15/31] 10.222.0.32 () {64 vars in 1282 bytes} [Mon May 30 11:57:00 2022] POST /compute/v2.1/flavors => generated 405 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 30 11:57:00.610852 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi [None req-e5940bb2-f344-4320-bc5a-0211ba4e6ad7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 11:57:00.634401 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: INFO nova.api.openstack.requestlog [None req-e5940bb2-f344-4320-bc5a-0211ba4e6ad7 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027253 May 30 11:57:00.635794 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: [pid: 103262|app: 0|req: 17/32] 10.222.0.32 () {64 vars in 1332 bytes} [Mon May 30 11:57:00 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 11:57:03.017124 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-84dd391e-dc52-41b9-81bc-60b96cd0ad3b admin admin] Calling method '>' {{(pid=103261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 11:57:03.018139 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: INFO nova.api.openstack.requestlog [None req-84dd391e-dc52-41b9-81bc-60b96cd0ad3b admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001744 May 30 11:57:03.022592 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: [pid: 103261|app: 0|req: 16/33] 10.222.0.32 () {54 vars in 930 bytes} [Mon May 30 11:57:03 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 11:57:03.086628 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi [None req-d40daddd-1d95-44be-ae22-72a263565f98 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 8, "disk": 160, "name": "m1.xlarge", "id": "5", "ram": 16384, "rxtx_factor": 1.0}} {{(pid=103262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 11:57:03.106867 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: INFO nova.api.openstack.requestlog [None req-d40daddd-1d95-44be-ae22-72a263565f98 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.076861 May 30 11:57:03.107429 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: [pid: 103262|app: 0|req: 18/34] 10.222.0.32 () {64 vars in 1282 bytes} [Mon May 30 11:57:03 2022] POST /compute/v2.1/flavors => generated 408 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 30 11:57:03.119286 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-f0e73f6f-9dc9-4203-9095-d977a29a7be3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 11:57:03.144426 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: INFO nova.api.openstack.requestlog [None req-f0e73f6f-9dc9-4203-9095-d977a29a7be3 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028751 May 30 11:57:03.145167 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: [pid: 103261|app: 0|req: 17/35] 10.222.0.32 () {64 vars in 1332 bytes} [Mon May 30 11:57:03 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 11:57:27.447192 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi [None req-d40daddd-1d95-44be-ae22-72a263565f98 admin admin] Calling method '>' {{(pid=103262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 11:57:27.448247 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: INFO nova.api.openstack.requestlog [None req-d40daddd-1d95-44be-ae22-72a263565f98 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001537 May 30 11:57:27.448659 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: [pid: 103262|app: 0|req: 19/36] 10.222.0.32 () {54 vars in 930 bytes} [Mon May 30 11:57:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 11:57:27.459133 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG dbcounter [-] [103261] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:27.508557 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-a111cbe9-9509-424a-94dc-6bf363f46c75 admin admin] Calling method '>' {{(pid=103261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 11:57:27.526206 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: INFO nova.api.openstack.requestlog [None req-a111cbe9-9509-424a-94dc-6bf363f46c75 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.071635 May 30 11:57:27.526745 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: [pid: 103261|app: 0|req: 18/37] 10.222.0.32 () {60 vars in 1291 bytes} [Mon May 30 11:57:27 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 11:57:28.539266 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi [None req-d40daddd-1d95-44be-ae22-72a263565f98 admin admin] Calling method '>' {{(pid=103262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 11:57:28.540297 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: INFO nova.api.openstack.requestlog [None req-d40daddd-1d95-44be-ae22-72a263565f98 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 May 30 11:57:28.540762 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: [pid: 103262|app: 0|req: 20/38] 10.222.0.32 () {56 vars in 1074 bytes} [Mon May 30 11:57:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 11:57:28.740848 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-3577079d-509d-4465-bbe7-dc7002a431b8 admin admin] Calling method '>' {{(pid=103261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 11:57:28.747463 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: INFO nova.api.openstack.wsgi [None req-3577079d-509d-4465-bbe7-dc7002a431b8 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 30 11:57:28.752365 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-3577079d-509d-4465-bbe7-dc7002a431b8 admin admin] Request method failure captured: May 30 11:57:28.752365 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 30 11:57:28.752365 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: Accept: application/json May 30 11:57:28.752365 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: Accept-Encoding: gzip, deflate May 30 11:57:28.752365 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: Connection: keep-alive May 30 11:57:28.752365 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: Content-Length: 0 May 30 11:57:28.752365 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: Host: 10.222.0.32 May 30 11:57:28.752365 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: Openstack-Api-Version: compute 2.90 May 30 11:57:28.752365 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: Openstack-System-Scope: None May 30 11:57:28.752365 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: User-Agent: python-novaclient May 30 11:57:28.752365 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: X-Auth-Token: gAAAAABilLEo2GVI3pAtPFWlBhfvDWRSbQL5fyBUbxl96T6LMZnG-gxnt4xHIzICZJz8M1UZbIY0594LEifV12YNrZdeIHbcE-MYSsDDq3oo0IWXSCm1rczly38zwJWeXzJlEiiD8ozDpk7VPQ6dTO7-dAftCJsyAhz2zX2Avk_fwaXq4k5ME90 May 30 11:57:28.752365 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: X-Domain-Id: None May 30 11:57:28.752365 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: X-Domain-Name: None May 30 11:57:28.752365 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: X-Identity-Status: Confirmed May 30 11:57:28.752365 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: X-Is-Admin-Project: True May 30 11:57:28.752365 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: X-Openstack-Nova-Api-Version: 2.90 May 30 11:57:28.752365 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: X-Project-Domain-Id: default May 30 11:57:28.752365 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: X-Project-Domain-Name: Default May 30 11:57:28.752365 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: X-Project-Id: 41eaf29f1f484186a95e357823daad72 May 30 11:57:28.752365 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: X-Project-Name: admin May 30 11:57:28.752365 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: X-Role: reader,member,admin May 30 11:57:28.752365 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: X-Roles: reader,member,admin May 30 11:57:28.754146 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/41eaf29f1f484186a95e357823daad72"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/41eaf29f1f484186a95e357823daad72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/41eaf29f1f484186a95e357823daad72"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_41eaf29f1f484186a95e357823daad72", "adminURL": "http://10.222.0.32:8080"}]}] May 30 11:57:28.754146 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: X-Tenant: admin May 30 11:57:28.754146 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: X-Tenant-Id: 41eaf29f1f484186a95e357823daad72 May 30 11:57:28.754146 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: X-Tenant-Name: admin May 30 11:57:28.754146 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: X-User: admin May 30 11:57:28.754146 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: X-User-Domain-Id: default May 30 11:57:28.754146 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: X-User-Domain-Name: Default May 30 11:57:28.754146 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: X-User-Id: a8ba729f356d47049a450132ac3851da May 30 11:57:28.754146 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: X-User-Name: admin May 30 11:57:28.754146 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: method: > May 30 11:57:28.754146 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: exception: Flavor 42 could not be found. May 30 11:57:28.754146 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: action_args: {'id': '42'} May 30 11:57:28.754146 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: {{(pid=103261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 11:57:28.754146 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 11:57:28.755203 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 30 11:57:28.755203 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 30 11:57:28.755203 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 30 11:57:28.755203 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 30 11:57:28.755203 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 30 11:57:28.755203 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 30 11:57:28.755203 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 30 11:57:28.755203 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 30 11:57:28.755203 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 30 11:57:28.755203 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 11:57:28.755203 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 30 11:57:28.755203 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 30 11:57:28.755203 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 30 11:57:28.755203 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi May 30 11:57:28.755203 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 11:57:28.755203 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi May 30 11:57:28.755203 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 11:57:28.755203 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 11:57:28.755203 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 11:57:28.756412 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 11:57:28.756412 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 11:57:28.756412 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 11:57:28.756412 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 11:57:28.756412 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 30 11:57:28.756412 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 30 11:57:28.756412 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 30 11:57:28.756412 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi May 30 11:57:28.756412 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 11:57:28.756412 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi May 30 11:57:28.756412 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 11:57:28.756412 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 11:57:28.756412 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 11:57:28.756412 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 11:57:28.756412 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 11:57:28.756412 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 30 11:57:28.756412 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi May 30 11:57:28.756412 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-3577079d-509d-4465-bbe7-dc7002a431b8 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103261) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 11:57:28.757453 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: INFO nova.api.openstack.requestlog [None req-3577079d-509d-4465-bbe7-dc7002a431b8 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.066243 May 30 11:57:28.757453 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: [pid: 103261|app: 0|req: 19/39] 10.222.0.32 () {60 vars in 1190 bytes} [Mon May 30 11:57:28 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 30 11:57:28.765102 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi [None req-828fedbd-f365-45be-8746-ea8d261bd611 admin admin] Calling method '>' {{(pid=103262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 11:57:28.768336 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG dbcounter [-] [103262] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:28.788901 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: INFO nova.api.openstack.requestlog [None req-828fedbd-f365-45be-8746-ea8d261bd611 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027327 May 30 11:57:28.789466 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: [pid: 103262|app: 0|req: 21/40] 10.222.0.32 () {60 vars in 1210 bytes} [Mon May 30 11:57:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 11:57:28.799551 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-7007135e-9965-4652-af02-d5f5992ceb50 admin admin] Calling method '>' {{(pid=103261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 11:57:28.820948 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: INFO nova.api.openstack.requestlog [None req-7007135e-9965-4652-af02-d5f5992ceb50 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024941 May 30 11:57:28.821486 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: [pid: 103261|app: 0|req: 20/41] 10.222.0.32 () {60 vars in 1210 bytes} [Mon May 30 11:57:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 11:57:28.832547 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi [None req-38ee159d-0c0d-40c1-8f9f-990befc42ef2 admin admin] Calling method '>' {{(pid=103262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 11:57:28.839292 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: INFO nova.api.openstack.wsgi [None req-38ee159d-0c0d-40c1-8f9f-990befc42ef2 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 30 11:57:28.842554 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi [None req-38ee159d-0c0d-40c1-8f9f-990befc42ef2 admin admin] Request method failure captured: May 30 11:57:28.842554 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 30 11:57:28.842554 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: Accept: application/json May 30 11:57:28.842554 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: Accept-Encoding: gzip, deflate May 30 11:57:28.842554 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: Connection: keep-alive May 30 11:57:28.842554 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: Content-Length: 0 May 30 11:57:28.842554 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: Host: 10.222.0.32 May 30 11:57:28.842554 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: Openstack-Api-Version: compute 2.90 May 30 11:57:28.842554 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: Openstack-System-Scope: None May 30 11:57:28.842554 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: User-Agent: python-novaclient May 30 11:57:28.842554 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: X-Auth-Token: gAAAAABilLEo2GVI3pAtPFWlBhfvDWRSbQL5fyBUbxl96T6LMZnG-gxnt4xHIzICZJz8M1UZbIY0594LEifV12YNrZdeIHbcE-MYSsDDq3oo0IWXSCm1rczly38zwJWeXzJlEiiD8ozDpk7VPQ6dTO7-dAftCJsyAhz2zX2Avk_fwaXq4k5ME90 May 30 11:57:28.842554 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: X-Domain-Id: None May 30 11:57:28.842554 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: X-Domain-Name: None May 30 11:57:28.842554 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: X-Identity-Status: Confirmed May 30 11:57:28.842554 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: X-Is-Admin-Project: True May 30 11:57:28.842554 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: X-Openstack-Nova-Api-Version: 2.90 May 30 11:57:28.842554 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: X-Project-Domain-Id: default May 30 11:57:28.842554 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: X-Project-Domain-Name: Default May 30 11:57:28.842554 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: X-Project-Id: 41eaf29f1f484186a95e357823daad72 May 30 11:57:28.842554 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: X-Project-Name: admin May 30 11:57:28.842554 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: X-Role: reader,member,admin May 30 11:57:28.842554 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: X-Roles: reader,member,admin May 30 11:57:28.843901 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/41eaf29f1f484186a95e357823daad72"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/41eaf29f1f484186a95e357823daad72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/41eaf29f1f484186a95e357823daad72"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_41eaf29f1f484186a95e357823daad72", "adminURL": "http://10.222.0.32:8080"}]}] May 30 11:57:28.843901 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: X-Tenant: admin May 30 11:57:28.843901 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: X-Tenant-Id: 41eaf29f1f484186a95e357823daad72 May 30 11:57:28.843901 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: X-Tenant-Name: admin May 30 11:57:28.843901 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: X-User: admin May 30 11:57:28.843901 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: X-User-Domain-Id: default May 30 11:57:28.843901 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: X-User-Domain-Name: Default May 30 11:57:28.843901 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: X-User-Id: a8ba729f356d47049a450132ac3851da May 30 11:57:28.843901 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: X-User-Name: admin May 30 11:57:28.843901 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: method: > May 30 11:57:28.843901 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: exception: Flavor 42 could not be found. May 30 11:57:28.843901 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: action_args: {'id': '42'} May 30 11:57:28.843901 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: {{(pid=103262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 11:57:28.843901 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 11:57:28.844938 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 30 11:57:28.844938 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 30 11:57:28.844938 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 30 11:57:28.844938 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 30 11:57:28.844938 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 30 11:57:28.844938 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 30 11:57:28.844938 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 30 11:57:28.844938 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 30 11:57:28.844938 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 30 11:57:28.844938 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 11:57:28.844938 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 30 11:57:28.844938 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 30 11:57:28.844938 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 30 11:57:28.844938 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi May 30 11:57:28.844938 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 11:57:28.844938 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi May 30 11:57:28.844938 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 11:57:28.844938 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 11:57:28.844938 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 11:57:28.845988 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 11:57:28.845988 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 11:57:28.845988 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 11:57:28.845988 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 11:57:28.845988 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 30 11:57:28.845988 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 30 11:57:28.845988 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 30 11:57:28.845988 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi May 30 11:57:28.845988 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 11:57:28.845988 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi May 30 11:57:28.845988 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 11:57:28.845988 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 11:57:28.845988 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 11:57:28.845988 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 11:57:28.845988 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 11:57:28.845988 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 30 11:57:28.845988 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi May 30 11:57:28.845988 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi [None req-38ee159d-0c0d-40c1-8f9f-990befc42ef2 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103262) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 11:57:28.847006 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: INFO nova.api.openstack.requestlog [None req-38ee159d-0c0d-40c1-8f9f-990befc42ef2 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015742 May 30 11:57:28.847006 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: [pid: 103262|app: 0|req: 22/42] 10.222.0.32 () {60 vars in 1190 bytes} [Mon May 30 11:57:28 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 30 11:57:29.718192 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-7007135e-9965-4652-af02-d5f5992ceb50 admin admin] Calling method '>' {{(pid=103261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 11:57:29.719216 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: INFO nova.api.openstack.requestlog [None req-7007135e-9965-4652-af02-d5f5992ceb50 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 May 30 11:57:29.719610 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: [pid: 103261|app: 0|req: 21/43] 10.222.0.32 () {56 vars in 1074 bytes} [Mon May 30 11:57:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 11:57:29.917971 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi [None req-2192562f-b303-4091-a09d-ef6a8b19fadb admin admin] Calling method '>' {{(pid=103262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 11:57:29.923475 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: INFO nova.api.openstack.wsgi [None req-2192562f-b303-4091-a09d-ef6a8b19fadb admin admin] HTTP exception thrown: Flavor 84 could not be found. May 30 11:57:29.925457 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi [None req-2192562f-b303-4091-a09d-ef6a8b19fadb admin admin] Request method failure captured: May 30 11:57:29.925457 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 30 11:57:29.925457 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: Accept: application/json May 30 11:57:29.925457 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: Accept-Encoding: gzip, deflate May 30 11:57:29.925457 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: Connection: keep-alive May 30 11:57:29.925457 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: Content-Length: 0 May 30 11:57:29.925457 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: Host: 10.222.0.32 May 30 11:57:29.925457 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: Openstack-Api-Version: compute 2.90 May 30 11:57:29.925457 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: Openstack-System-Scope: None May 30 11:57:29.925457 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: User-Agent: python-novaclient May 30 11:57:29.925457 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: X-Auth-Token: gAAAAABilLEp02LLrMNR_mmcyUYBCqXdJa2eHyO9wrwl49b8vJCjyOCJoZfLWkKe4294S6tC3DJ73NHGA7z-I9vNXVGo87LHIQy0HF5_BlP-nwoa-C7JePCkiu9sR8GW0XQkKjVnv5osPQqma2NVFcBgqhGzgUxz-2VWOkqnT-pJ7Ogz5tMr7ko May 30 11:57:29.925457 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: X-Domain-Id: None May 30 11:57:29.925457 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: X-Domain-Name: None May 30 11:57:29.925457 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: X-Identity-Status: Confirmed May 30 11:57:29.925457 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: X-Is-Admin-Project: True May 30 11:57:29.925457 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: X-Openstack-Nova-Api-Version: 2.90 May 30 11:57:29.925457 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: X-Project-Domain-Id: default May 30 11:57:29.925457 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: X-Project-Domain-Name: Default May 30 11:57:29.925457 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: X-Project-Id: 41eaf29f1f484186a95e357823daad72 May 30 11:57:29.925457 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: X-Project-Name: admin May 30 11:57:29.925457 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: X-Role: reader,member,admin May 30 11:57:29.925457 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: X-Roles: reader,member,admin May 30 11:57:29.927075 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/41eaf29f1f484186a95e357823daad72"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/41eaf29f1f484186a95e357823daad72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/41eaf29f1f484186a95e357823daad72"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_41eaf29f1f484186a95e357823daad72", "adminURL": "http://10.222.0.32:8080"}]}] May 30 11:57:29.927075 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: X-Tenant: admin May 30 11:57:29.927075 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: X-Tenant-Id: 41eaf29f1f484186a95e357823daad72 May 30 11:57:29.927075 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: X-Tenant-Name: admin May 30 11:57:29.927075 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: X-User: admin May 30 11:57:29.927075 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: X-User-Domain-Id: default May 30 11:57:29.927075 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: X-User-Domain-Name: Default May 30 11:57:29.927075 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: X-User-Id: a8ba729f356d47049a450132ac3851da May 30 11:57:29.927075 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: X-User-Name: admin May 30 11:57:29.927075 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: method: > May 30 11:57:29.927075 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: exception: Flavor 84 could not be found. May 30 11:57:29.927075 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: action_args: {'id': '84'} May 30 11:57:29.927075 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: {{(pid=103262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 11:57:29.927075 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 11:57:29.927897 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 30 11:57:29.927897 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 30 11:57:29.927897 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 30 11:57:29.927897 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 30 11:57:29.927897 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 30 11:57:29.927897 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 30 11:57:29.927897 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 30 11:57:29.927897 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 30 11:57:29.927897 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 30 11:57:29.927897 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 11:57:29.927897 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 30 11:57:29.927897 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 30 11:57:29.927897 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 30 11:57:29.927897 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi May 30 11:57:29.927897 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 11:57:29.927897 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi May 30 11:57:29.927897 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 11:57:29.927897 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 11:57:29.927897 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 11:57:29.929047 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 11:57:29.929047 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 11:57:29.929047 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 11:57:29.929047 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 11:57:29.929047 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 30 11:57:29.929047 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 30 11:57:29.929047 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 30 11:57:29.929047 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi May 30 11:57:29.929047 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 11:57:29.929047 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi May 30 11:57:29.929047 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 11:57:29.929047 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 11:57:29.929047 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 11:57:29.929047 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 11:57:29.929047 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 11:57:29.929047 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 30 11:57:29.929047 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi May 30 11:57:29.929047 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi [None req-2192562f-b303-4091-a09d-ef6a8b19fadb admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103262) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 11:57:29.930280 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: INFO nova.api.openstack.requestlog [None req-2192562f-b303-4091-a09d-ef6a8b19fadb admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.068765 May 30 11:57:29.930280 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: [pid: 103262|app: 0|req: 23/44] 10.222.0.32 () {60 vars in 1190 bytes} [Mon May 30 11:57:29 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 30 11:57:29.936843 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-7068a08a-8448-4404-81d0-d065fb347488 admin admin] Calling method '>' {{(pid=103261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 11:57:29.951503 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: INFO nova.api.openstack.requestlog [None req-7068a08a-8448-4404-81d0-d065fb347488 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018203 May 30 11:57:29.952078 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: [pid: 103261|app: 0|req: 22/45] 10.222.0.32 () {60 vars in 1210 bytes} [Mon May 30 11:57:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 11:57:29.961617 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi [None req-40c25c6f-814d-4468-8cf4-f22c45ba0f27 admin admin] Calling method '>' {{(pid=103262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 11:57:29.976318 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: INFO nova.api.openstack.requestlog [None req-40c25c6f-814d-4468-8cf4-f22c45ba0f27 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018225 May 30 11:57:29.976863 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: [pid: 103262|app: 0|req: 24/46] 10.222.0.32 () {60 vars in 1210 bytes} [Mon May 30 11:57:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 11:57:29.986839 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-2f65985d-5fb8-42d6-ad83-3dd75e149357 admin admin] Calling method '>' {{(pid=103261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 11:57:29.992428 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: INFO nova.api.openstack.wsgi [None req-2f65985d-5fb8-42d6-ad83-3dd75e149357 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 30 11:57:29.994205 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-2f65985d-5fb8-42d6-ad83-3dd75e149357 admin admin] Request method failure captured: May 30 11:57:29.994205 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 30 11:57:29.994205 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: Accept: application/json May 30 11:57:29.994205 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: Accept-Encoding: gzip, deflate May 30 11:57:29.994205 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: Connection: keep-alive May 30 11:57:29.994205 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: Content-Length: 0 May 30 11:57:29.994205 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: Host: 10.222.0.32 May 30 11:57:29.994205 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: Openstack-Api-Version: compute 2.90 May 30 11:57:29.994205 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: Openstack-System-Scope: None May 30 11:57:29.994205 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: User-Agent: python-novaclient May 30 11:57:29.994205 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: X-Auth-Token: gAAAAABilLEp02LLrMNR_mmcyUYBCqXdJa2eHyO9wrwl49b8vJCjyOCJoZfLWkKe4294S6tC3DJ73NHGA7z-I9vNXVGo87LHIQy0HF5_BlP-nwoa-C7JePCkiu9sR8GW0XQkKjVnv5osPQqma2NVFcBgqhGzgUxz-2VWOkqnT-pJ7Ogz5tMr7ko May 30 11:57:29.994205 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: X-Domain-Id: None May 30 11:57:29.994205 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: X-Domain-Name: None May 30 11:57:29.994205 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: X-Identity-Status: Confirmed May 30 11:57:29.994205 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: X-Is-Admin-Project: True May 30 11:57:29.994205 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: X-Openstack-Nova-Api-Version: 2.90 May 30 11:57:29.994205 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: X-Project-Domain-Id: default May 30 11:57:29.994205 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: X-Project-Domain-Name: Default May 30 11:57:29.994205 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: X-Project-Id: 41eaf29f1f484186a95e357823daad72 May 30 11:57:29.994205 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: X-Project-Name: admin May 30 11:57:29.994205 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: X-Role: reader,member,admin May 30 11:57:29.994205 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: X-Roles: reader,member,admin May 30 11:57:29.995710 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/41eaf29f1f484186a95e357823daad72"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/41eaf29f1f484186a95e357823daad72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/41eaf29f1f484186a95e357823daad72"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_41eaf29f1f484186a95e357823daad72", "adminURL": "http://10.222.0.32:8080"}]}] May 30 11:57:29.995710 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: X-Tenant: admin May 30 11:57:29.995710 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: X-Tenant-Id: 41eaf29f1f484186a95e357823daad72 May 30 11:57:29.995710 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: X-Tenant-Name: admin May 30 11:57:29.995710 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: X-User: admin May 30 11:57:29.995710 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: X-User-Domain-Id: default May 30 11:57:29.995710 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: X-User-Domain-Name: Default May 30 11:57:29.995710 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: X-User-Id: a8ba729f356d47049a450132ac3851da May 30 11:57:29.995710 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: X-User-Name: admin May 30 11:57:29.995710 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: method: > May 30 11:57:29.995710 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: exception: Flavor 84 could not be found. May 30 11:57:29.995710 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: action_args: {'id': '84'} May 30 11:57:29.995710 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: {{(pid=103261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 11:57:29.995710 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 11:57:29.996577 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 30 11:57:29.996577 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 30 11:57:29.996577 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 30 11:57:29.996577 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 30 11:57:29.996577 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 30 11:57:29.996577 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 30 11:57:29.996577 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 30 11:57:29.996577 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 30 11:57:29.996577 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 30 11:57:29.996577 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 11:57:29.996577 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 30 11:57:29.996577 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 30 11:57:29.996577 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 30 11:57:29.996577 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi May 30 11:57:29.996577 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 11:57:29.996577 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi May 30 11:57:29.996577 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 11:57:29.996577 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 11:57:29.996577 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 11:57:29.997596 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 11:57:29.997596 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 11:57:29.997596 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 11:57:29.997596 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 11:57:29.997596 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 30 11:57:29.997596 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 30 11:57:29.997596 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 30 11:57:29.997596 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi May 30 11:57:29.997596 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 11:57:29.997596 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi May 30 11:57:29.997596 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 11:57:29.997596 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 11:57:29.997596 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 11:57:29.997596 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 11:57:29.997596 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 11:57:29.997596 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 30 11:57:29.997596 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi May 30 11:57:29.997596 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-2f65985d-5fb8-42d6-ad83-3dd75e149357 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103261) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 11:57:29.998619 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: INFO nova.api.openstack.requestlog [None req-2f65985d-5fb8-42d6-ad83-3dd75e149357 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012686 May 30 11:57:30.000229 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: [pid: 103261|app: 0|req: 23/47] 10.222.0.32 () {60 vars in 1190 bytes} [Mon May 30 11:57:29 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 30 11:57:30.884917 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi [None req-40c25c6f-814d-4468-8cf4-f22c45ba0f27 admin admin] Calling method '>' {{(pid=103262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 11:57:30.886035 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: INFO nova.api.openstack.requestlog [None req-40c25c6f-814d-4468-8cf4-f22c45ba0f27 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001692 May 30 11:57:30.886436 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: [pid: 103262|app: 0|req: 25/48] 10.222.0.32 () {56 vars in 1074 bytes} [Mon May 30 11:57:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 11:57:31.076339 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-cffb73ab-639b-4473-bfcc-6ce79526ddff admin admin] Calling method '>' {{(pid=103261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 11:57:31.081889 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: INFO nova.api.openstack.wsgi [None req-cffb73ab-639b-4473-bfcc-6ce79526ddff admin admin] HTTP exception thrown: Flavor 451 could not be found. May 30 11:57:31.083393 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-cffb73ab-639b-4473-bfcc-6ce79526ddff admin admin] Request method failure captured: May 30 11:57:31.083393 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 30 11:57:31.083393 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: Accept: application/json May 30 11:57:31.083393 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: Accept-Encoding: gzip, deflate May 30 11:57:31.083393 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: Connection: keep-alive May 30 11:57:31.083393 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: Content-Length: 0 May 30 11:57:31.083393 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: Host: 10.222.0.32 May 30 11:57:31.083393 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: Openstack-Api-Version: compute 2.90 May 30 11:57:31.083393 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: Openstack-System-Scope: None May 30 11:57:31.083393 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: User-Agent: python-novaclient May 30 11:57:31.083393 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: X-Auth-Token: gAAAAABilLEqgXYvYEXALsjvMEwmGfHFdfnzm_i10WFfXDDdzarBSY0MX5zAswOvnkf4tYFPzNyca0Zu6Soe84TayncXDrcuX1YywbM3qHvFvatrR2MnJJbcYx_zOXJa4KLPOLxpTIqalWbnvywsuRWda_TnZc_6nD7P4UtzsZSWmljKGJXvxIc May 30 11:57:31.083393 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: X-Domain-Id: None May 30 11:57:31.083393 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: X-Domain-Name: None May 30 11:57:31.083393 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: X-Identity-Status: Confirmed May 30 11:57:31.083393 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: X-Is-Admin-Project: True May 30 11:57:31.083393 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: X-Openstack-Nova-Api-Version: 2.90 May 30 11:57:31.083393 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: X-Project-Domain-Id: default May 30 11:57:31.083393 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: X-Project-Domain-Name: Default May 30 11:57:31.083393 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: X-Project-Id: 41eaf29f1f484186a95e357823daad72 May 30 11:57:31.083393 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: X-Project-Name: admin May 30 11:57:31.083393 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: X-Role: reader,member,admin May 30 11:57:31.083393 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: X-Roles: reader,member,admin May 30 11:57:31.085077 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/41eaf29f1f484186a95e357823daad72"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/41eaf29f1f484186a95e357823daad72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/41eaf29f1f484186a95e357823daad72"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_41eaf29f1f484186a95e357823daad72", "adminURL": "http://10.222.0.32:8080"}]}] May 30 11:57:31.085077 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: X-Tenant: admin May 30 11:57:31.085077 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: X-Tenant-Id: 41eaf29f1f484186a95e357823daad72 May 30 11:57:31.085077 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: X-Tenant-Name: admin May 30 11:57:31.085077 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: X-User: admin May 30 11:57:31.085077 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: X-User-Domain-Id: default May 30 11:57:31.085077 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: X-User-Domain-Name: Default May 30 11:57:31.085077 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: X-User-Id: a8ba729f356d47049a450132ac3851da May 30 11:57:31.085077 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: X-User-Name: admin May 30 11:57:31.085077 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: method: > May 30 11:57:31.085077 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: exception: Flavor 451 could not be found. May 30 11:57:31.085077 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: action_args: {'id': '451'} May 30 11:57:31.085077 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: {{(pid=103261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 11:57:31.085077 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 11:57:31.086067 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 30 11:57:31.086067 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 30 11:57:31.086067 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 30 11:57:31.086067 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 30 11:57:31.086067 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 30 11:57:31.086067 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 30 11:57:31.086067 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 30 11:57:31.086067 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 30 11:57:31.086067 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 30 11:57:31.086067 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 11:57:31.086067 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 30 11:57:31.086067 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 30 11:57:31.086067 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 30 11:57:31.086067 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi May 30 11:57:31.086067 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 11:57:31.086067 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi May 30 11:57:31.086067 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 11:57:31.086067 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 11:57:31.086067 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 11:57:31.088305 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 11:57:31.088305 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 11:57:31.088305 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 11:57:31.088305 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 11:57:31.088305 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 30 11:57:31.088305 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 30 11:57:31.088305 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 30 11:57:31.088305 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi May 30 11:57:31.088305 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 11:57:31.088305 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi May 30 11:57:31.088305 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 11:57:31.088305 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 11:57:31.088305 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 11:57:31.088305 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 11:57:31.088305 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 11:57:31.088305 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 30 11:57:31.088305 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: ERROR nova.api.openstack.wsgi May 30 11:57:31.088305 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-cffb73ab-639b-4473-bfcc-6ce79526ddff admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103261) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 11:57:31.089553 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: INFO nova.api.openstack.requestlog [None req-cffb73ab-639b-4473-bfcc-6ce79526ddff admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.061372 May 30 11:57:31.089553 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: [pid: 103261|app: 0|req: 24/49] 10.222.0.32 () {60 vars in 1193 bytes} [Mon May 30 11:57:31 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 30 11:57:31.095430 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi [None req-11554a48-5ce2-407e-99a5-63b2f700b41a admin admin] Calling method '>' {{(pid=103262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 11:57:31.109762 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: INFO nova.api.openstack.requestlog [None req-11554a48-5ce2-407e-99a5-63b2f700b41a admin admin] 10.222.0.32 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017910 May 30 11:57:31.110302 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: [pid: 103262|app: 0|req: 26/50] 10.222.0.32 () {60 vars in 1210 bytes} [Mon May 30 11:57:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 11:57:31.120084 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-4b332525-c0f0-468f-a1f5-6c73a9cc646e admin admin] Calling method '>' {{(pid=103261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 11:57:31.133548 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: INFO nova.api.openstack.requestlog [None req-4b332525-c0f0-468f-a1f5-6c73a9cc646e admin admin] 10.222.0.32 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017103 May 30 11:57:31.134080 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: [pid: 103261|app: 0|req: 25/51] 10.222.0.32 () {60 vars in 1210 bytes} [Mon May 30 11:57:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 11:57:31.143858 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi [None req-09c70dc0-b9ee-40ea-8673-2fd6b01b7cb2 admin admin] Calling method '>' {{(pid=103262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 11:57:31.149170 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: INFO nova.api.openstack.wsgi [None req-09c70dc0-b9ee-40ea-8673-2fd6b01b7cb2 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 30 11:57:31.151225 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi [None req-09c70dc0-b9ee-40ea-8673-2fd6b01b7cb2 admin admin] Request method failure captured: May 30 11:57:31.151225 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 30 11:57:31.151225 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: Accept: application/json May 30 11:57:31.151225 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: Accept-Encoding: gzip, deflate May 30 11:57:31.151225 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: Connection: keep-alive May 30 11:57:31.151225 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: Content-Length: 0 May 30 11:57:31.151225 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: Host: 10.222.0.32 May 30 11:57:31.151225 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: Openstack-Api-Version: compute 2.90 May 30 11:57:31.151225 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: Openstack-System-Scope: None May 30 11:57:31.151225 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: User-Agent: python-novaclient May 30 11:57:31.151225 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: X-Auth-Token: gAAAAABilLEqgXYvYEXALsjvMEwmGfHFdfnzm_i10WFfXDDdzarBSY0MX5zAswOvnkf4tYFPzNyca0Zu6Soe84TayncXDrcuX1YywbM3qHvFvatrR2MnJJbcYx_zOXJa4KLPOLxpTIqalWbnvywsuRWda_TnZc_6nD7P4UtzsZSWmljKGJXvxIc May 30 11:57:31.151225 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: X-Domain-Id: None May 30 11:57:31.151225 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: X-Domain-Name: None May 30 11:57:31.151225 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: X-Identity-Status: Confirmed May 30 11:57:31.151225 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: X-Is-Admin-Project: True May 30 11:57:31.151225 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: X-Openstack-Nova-Api-Version: 2.90 May 30 11:57:31.151225 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: X-Project-Domain-Id: default May 30 11:57:31.151225 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: X-Project-Domain-Name: Default May 30 11:57:31.151225 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: X-Project-Id: 41eaf29f1f484186a95e357823daad72 May 30 11:57:31.151225 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: X-Project-Name: admin May 30 11:57:31.151225 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: X-Role: reader,member,admin May 30 11:57:31.151225 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: X-Roles: reader,member,admin May 30 11:57:31.153022 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/41eaf29f1f484186a95e357823daad72"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/41eaf29f1f484186a95e357823daad72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/41eaf29f1f484186a95e357823daad72"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_41eaf29f1f484186a95e357823daad72", "adminURL": "http://10.222.0.32:8080"}]}] May 30 11:57:31.153022 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: X-Tenant: admin May 30 11:57:31.153022 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: X-Tenant-Id: 41eaf29f1f484186a95e357823daad72 May 30 11:57:31.153022 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: X-Tenant-Name: admin May 30 11:57:31.153022 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: X-User: admin May 30 11:57:31.153022 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: X-User-Domain-Id: default May 30 11:57:31.153022 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: X-User-Domain-Name: Default May 30 11:57:31.153022 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: X-User-Id: a8ba729f356d47049a450132ac3851da May 30 11:57:31.153022 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: X-User-Name: admin May 30 11:57:31.153022 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: method: > May 30 11:57:31.153022 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: exception: Flavor 451 could not be found. May 30 11:57:31.153022 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: action_args: {'id': '451'} May 30 11:57:31.153022 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: {{(pid=103262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 11:57:31.153022 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 11:57:31.154010 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 30 11:57:31.154010 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 30 11:57:31.154010 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 30 11:57:31.154010 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 30 11:57:31.154010 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 30 11:57:31.154010 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 30 11:57:31.154010 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 30 11:57:31.154010 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 30 11:57:31.154010 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 30 11:57:31.154010 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 11:57:31.154010 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 30 11:57:31.154010 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 30 11:57:31.154010 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 30 11:57:31.154010 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi May 30 11:57:31.154010 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 11:57:31.154010 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi May 30 11:57:31.154010 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 11:57:31.154010 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 11:57:31.154010 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 11:57:31.155302 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 11:57:31.155302 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 11:57:31.155302 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 11:57:31.155302 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 11:57:31.155302 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 30 11:57:31.155302 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 30 11:57:31.155302 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 30 11:57:31.155302 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi May 30 11:57:31.155302 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 11:57:31.155302 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi May 30 11:57:31.155302 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 11:57:31.155302 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 11:57:31.155302 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 11:57:31.155302 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 11:57:31.155302 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 11:57:31.155302 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 30 11:57:31.155302 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: ERROR nova.api.openstack.wsgi May 30 11:57:31.155302 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi [None req-09c70dc0-b9ee-40ea-8673-2fd6b01b7cb2 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103262) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 11:57:31.156556 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: INFO nova.api.openstack.requestlog [None req-09c70dc0-b9ee-40ea-8673-2fd6b01b7cb2 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012582 May 30 11:57:31.156556 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: [pid: 103262|app: 0|req: 27/52] 10.222.0.32 () {60 vars in 1193 bytes} [Mon May 30 11:57:31 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 30 11:57:32.042468 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-4b332525-c0f0-468f-a1f5-6c73a9cc646e admin admin] Calling method '>' {{(pid=103261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 11:57:32.043475 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: INFO nova.api.openstack.requestlog [None req-4b332525-c0f0-468f-a1f5-6c73a9cc646e admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 May 30 11:57:32.043877 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: [pid: 103261|app: 0|req: 26/53] 10.222.0.32 () {56 vars in 1074 bytes} [Mon May 30 11:57:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 11:57:32.233245 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi [None req-5f7e9bdd-cc63-499b-998b-4fb4b23e1153 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 11:57:32.250582 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: INFO nova.api.openstack.requestlog [None req-5f7e9bdd-cc63-499b-998b-4fb4b23e1153 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.069046 May 30 11:57:32.251013 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: [pid: 103262|app: 0|req: 28/54] 10.222.0.32 () {64 vars in 1235 bytes} [Mon May 30 11:57:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 30 11:57:33.137826 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-4b332525-c0f0-468f-a1f5-6c73a9cc646e admin admin] Calling method '>' {{(pid=103261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 11:57:33.139207 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: INFO nova.api.openstack.requestlog [None req-4b332525-c0f0-468f-a1f5-6c73a9cc646e admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 May 30 11:57:33.139207 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: [pid: 103261|app: 0|req: 27/55] 10.222.0.32 () {56 vars in 1074 bytes} [Mon May 30 11:57:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 11:57:33.336931 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi [None req-7d2e8cd7-c512-44ad-8bb9-9c9c643e8afc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 11:57:33.356390 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: INFO nova.api.openstack.requestlog [None req-7d2e8cd7-c512-44ad-8bb9-9c9c643e8afc admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.073725 May 30 11:57:33.356898 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: [pid: 103262|app: 0|req: 29/56] 10.222.0.32 () {64 vars in 1235 bytes} [Mon May 30 11:57:33 2022] POST /compute/v2.1/flavors => generated 405 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 30 11:57:34.243637 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-4b332525-c0f0-468f-a1f5-6c73a9cc646e admin admin] Calling method '>' {{(pid=103261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 11:57:34.244689 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: INFO nova.api.openstack.requestlog [None req-4b332525-c0f0-468f-a1f5-6c73a9cc646e admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 May 30 11:57:34.245085 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: [pid: 103261|app: 0|req: 28/57] 10.222.0.32 () {56 vars in 1074 bytes} [Mon May 30 11:57:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 11:57:34.443811 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi [None req-d6e56e73-9746-43a4-8e79-7d1460523409 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 11:57:34.463297 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: INFO nova.api.openstack.requestlog [None req-d6e56e73-9746-43a4-8e79-7d1460523409 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.075963 May 30 11:57:34.463793 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: [pid: 103262|app: 0|req: 30/58] 10.222.0.32 () {64 vars in 1235 bytes} [Mon May 30 11:57:34 2022] POST /compute/v2.1/flavors => generated 407 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 30 11:57:35.378698 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-4b332525-c0f0-468f-a1f5-6c73a9cc646e admin admin] Calling method '>' {{(pid=103261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 11:57:35.380485 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: INFO nova.api.openstack.requestlog [None req-4b332525-c0f0-468f-a1f5-6c73a9cc646e admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002467 May 30 11:57:35.381200 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: [pid: 103261|app: 0|req: 29/59] 10.222.0.32 () {56 vars in 1074 bytes} [Mon May 30 11:57:35 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 11:57:35.581342 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi [None req-1ee3d246-0d3f-4f3f-85e9-a205598a879c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 11:57:35.600452 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: INFO nova.api.openstack.requestlog [None req-1ee3d246-0d3f-4f3f-85e9-a205598a879c admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.072503 May 30 11:57:35.601001 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: [pid: 103262|app: 0|req: 31/60] 10.222.0.32 () {64 vars in 1235 bytes} [Mon May 30 11:57:35 2022] POST /compute/v2.1/flavors => generated 409 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 30 11:57:36.499680 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-4b332525-c0f0-468f-a1f5-6c73a9cc646e admin admin] Calling method '>' {{(pid=103261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 11:57:36.500729 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: INFO nova.api.openstack.requestlog [None req-4b332525-c0f0-468f-a1f5-6c73a9cc646e admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 May 30 11:57:36.501127 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: [pid: 103261|app: 0|req: 30/61] 10.222.0.32 () {56 vars in 1074 bytes} [Mon May 30 11:57:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 11:57:36.692761 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi [None req-ad42e66b-ba39-472d-b027-843654f339f6 admin admin] Calling method '>' {{(pid=103262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 11:57:36.713337 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: INFO nova.api.openstack.requestlog [None req-ad42e66b-ba39-472d-b027-843654f339f6 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.072775 May 30 11:57:36.713877 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: [pid: 103262|app: 0|req: 32/62] 10.222.0.32 () {60 vars in 1202 bytes} [Mon May 30 11:57:36 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 11:58:38.866916 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-4b332525-c0f0-468f-a1f5-6c73a9cc646e admin admin] Calling method '>' {{(pid=103261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 11:58:38.867906 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: INFO nova.api.openstack.requestlog [None req-4b332525-c0f0-468f-a1f5-6c73a9cc646e admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 May 30 11:58:38.868342 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: [pid: 103261|app: 0|req: 31/63] 10.222.0.32 () {54 vars in 930 bytes} [Mon May 30 11:58:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 11:58:38.877896 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG dbcounter [-] [103262] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:58:38.928886 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi [None req-db909230-e7c0-4f8f-b1ac-55430d063fc8 admin admin] Calling method '>' {{(pid=103262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 11:58:38.948351 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: INFO nova.api.openstack.requestlog [None req-db909230-e7c0-4f8f-b1ac-55430d063fc8 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.074030 May 30 11:58:38.948891 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: [pid: 103262|app: 0|req: 33/64] 10.222.0.32 () {60 vars in 1291 bytes} [Mon May 30 11:58:38 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 11:58:38.970196 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG dbcounter [-] [103261] Writing DB stats nova_api:SELECT=14 {{(pid=103261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:58:38.973912 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-3d60e0c8-e2ae-4d0d-8628-ba36e77abaea admin admin] Calling method '>' {{(pid=103261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 11:58:38.981768 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: INFO nova.api.openstack.requestlog [None req-3d60e0c8-e2ae-4d0d-8628-ba36e77abaea admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012965 May 30 11:58:38.982315 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: [pid: 103261|app: 0|req: 32/65] 10.222.0.32 () {60 vars in 1282 bytes} [Mon May 30 11:58:38 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 11:58:38.993815 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi [None req-3f57f00b-6f28-40fe-a02f-4ac0652ae4e7 admin admin] Calling method '>' {{(pid=103262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 11:58:39.001529 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: INFO nova.api.openstack.requestlog [None req-3f57f00b-6f28-40fe-a02f-4ac0652ae4e7 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011295 May 30 11:58:39.002073 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: [pid: 103262|app: 0|req: 34/66] 10.222.0.32 () {60 vars in 1285 bytes} [Mon May 30 11:58:38 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 11:58:39.016387 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-155f082b-deb0-4d19-9d75-333b95bf3d14 admin admin] Calling method '>' {{(pid=103261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 11:58:39.025762 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: INFO nova.api.openstack.requestlog [None req-155f082b-deb0-4d19-9d75-333b95bf3d14 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014770 May 30 11:58:39.026386 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: [pid: 103261|app: 0|req: 33/67] 10.222.0.32 () {60 vars in 1285 bytes} [Mon May 30 11:58:39 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 11:58:39.038087 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi [None req-a065dca5-c4d4-4061-b34c-5576c3cd321a admin admin] Calling method '>' {{(pid=103262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 11:58:39.045959 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: INFO nova.api.openstack.requestlog [None req-a065dca5-c4d4-4061-b34c-5576c3cd321a admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011444 May 30 11:58:39.046484 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: [pid: 103262|app: 0|req: 35/68] 10.222.0.32 () {60 vars in 1282 bytes} [Mon May 30 11:58:39 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:01:57.467748 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-155f082b-deb0-4d19-9d75-333b95bf3d14 admin admin] Calling method '>' {{(pid=103261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:01:57.468817 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: INFO nova.api.openstack.requestlog [None req-155f082b-deb0-4d19-9d75-333b95bf3d14 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 May 30 12:01:57.469190 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: [pid: 103261|app: 0|req: 34/69] 10.222.0.32 () {56 vars in 1074 bytes} [Mon May 30 12:01:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 30 12:01:57.635536 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG dbcounter [-] [103262] Writing DB stats nova_api:SELECT=6 {{(pid=103262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:01:57.750797 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi [None req-d1838908-afb3-410c-bc4f-e589c5fa1f62 admin admin] Calling method '>' {{(pid=103262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:01:57.751951 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 30 12:01:57.751951 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: warnings.warn(msg) May 30 12:01:57.753191 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG oslo_concurrency.lockutils [None req-d1838908-afb3-410c-bc4f-e589c5fa1f62 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:01:57.753632 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG oslo_concurrency.lockutils [None req-d1838908-afb3-410c-bc4f-e589c5fa1f62 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:01:57.754416 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG oslo_concurrency.lockutils [None req-d1838908-afb3-410c-bc4f-e589c5fa1f62 admin admin] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:01:57.754869 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG oslo_concurrency.lockutils [None req-d1838908-afb3-410c-bc4f-e589c5fa1f62 admin admin] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:01:57.789231 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: INFO nova.api.openstack.requestlog [None req-d1838908-afb3-410c-bc4f-e589c5fa1f62 admin admin] 10.222.0.32 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.155182 May 30 12:01:57.789787 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: [pid: 103262|app: 0|req: 36/70] 10.222.0.32 () {60 vars in 1193 bytes} [Mon May 30 12:01:57 2022] GET /compute/v2.1/os-services => generated 791 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 30 12:01:58.686592 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-155f082b-deb0-4d19-9d75-333b95bf3d14 admin admin] Calling method '>' {{(pid=103261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:01:58.687607 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: INFO nova.api.openstack.requestlog [None req-155f082b-deb0-4d19-9d75-333b95bf3d14 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 May 30 12:01:58.688004 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: [pid: 103261|app: 0|req: 35/71] 10.222.0.32 () {56 vars in 1074 bytes} [Mon May 30 12:01:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:01:58.898413 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi [None req-f46b2805-438c-434a-b390-4451eed62bfe admin admin] Calling method '>' {{(pid=103262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:01:58.899779 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 30 12:01:58.899779 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: warnings.warn(msg) May 30 12:01:58.901668 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG oslo_concurrency.lockutils [None req-f46b2805-438c-434a-b390-4451eed62bfe admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:01:58.902120 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG oslo_concurrency.lockutils [None req-f46b2805-438c-434a-b390-4451eed62bfe admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:01:58.902917 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG oslo_concurrency.lockutils [None req-f46b2805-438c-434a-b390-4451eed62bfe admin admin] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:01:58.903348 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG oslo_concurrency.lockutils [None req-f46b2805-438c-434a-b390-4451eed62bfe admin admin] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:01:58.924224 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: INFO nova.api.openstack.requestlog [None req-f46b2805-438c-434a-b390-4451eed62bfe admin admin] 10.222.0.32 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.090336 May 30 12:01:58.924785 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: [pid: 103262|app: 0|req: 37/72] 10.222.0.32 () {60 vars in 1193 bytes} [Mon May 30 12:01:58 2022] GET /compute/v2.1/os-services => generated 791 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 30 12:02:10.246272 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-155f082b-deb0-4d19-9d75-333b95bf3d14 admin admin] Calling method '>' {{(pid=103261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:02:10.247357 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: INFO nova.api.openstack.requestlog [None req-155f082b-deb0-4d19-9d75-333b95bf3d14 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001527 May 30 12:02:10.247794 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: [pid: 103261|app: 0|req: 36/73] 10.222.0.32 () {56 vars in 1074 bytes} [Mon May 30 12:02:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:02:10.393775 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG dbcounter [-] [103262] Writing DB stats nova_cell0:SELECT=4 {{(pid=103262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:02:10.394482 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG dbcounter [-] [103262] Writing DB stats nova_cell1:SELECT=4 {{(pid=103262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:02:10.395399 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG dbcounter [-] [103262] Writing DB stats nova_api:SELECT=8 {{(pid=103262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:02:10.444078 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi [None req-4e8aaff5-d270-44b0-99bb-199ccd290f2c admin admin] Calling method '>' {{(pid=103262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:02:10.445258 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 30 12:02:10.445258 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: warnings.warn(msg) May 30 12:02:10.446477 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG oslo_concurrency.lockutils [None req-4e8aaff5-d270-44b0-99bb-199ccd290f2c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:02:10.446926 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG oslo_concurrency.lockutils [None req-4e8aaff5-d270-44b0-99bb-199ccd290f2c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:02:10.447716 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG oslo_concurrency.lockutils [None req-4e8aaff5-d270-44b0-99bb-199ccd290f2c admin admin] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:02:10.448198 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG oslo_concurrency.lockutils [None req-4e8aaff5-d270-44b0-99bb-199ccd290f2c admin admin] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:02:10.473226 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: INFO nova.api.openstack.requestlog [None req-4e8aaff5-d270-44b0-99bb-199ccd290f2c admin admin] 10.222.0.32 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.083785 May 30 12:02:10.473783 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: [pid: 103262|app: 0|req: 38/74] 10.222.0.32 () {60 vars in 1193 bytes} [Mon May 30 12:02:10 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:02:11.363318 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: DEBUG nova.api.openstack.wsgi [None req-155f082b-deb0-4d19-9d75-333b95bf3d14 admin admin] Calling method '>' {{(pid=103261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:02:11.364363 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: INFO nova.api.openstack.requestlog [None req-155f082b-deb0-4d19-9d75-333b95bf3d14 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001569 May 30 12:02:11.364788 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: [pid: 103261|app: 0|req: 37/75] 10.222.0.32 () {56 vars in 1074 bytes} [Mon May 30 12:02:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:02:11.555648 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG nova.api.openstack.wsgi [None req-52eee02e-c9d9-4bf2-8acd-8e37caf23f5e admin admin] Calling method '>' {{(pid=103262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:02:11.556837 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 30 12:02:11.556837 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: warnings.warn(msg) May 30 12:02:11.558023 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG oslo_concurrency.lockutils [None req-52eee02e-c9d9-4bf2-8acd-8e37caf23f5e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:02:11.558462 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG oslo_concurrency.lockutils [None req-52eee02e-c9d9-4bf2-8acd-8e37caf23f5e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:02:11.559247 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG oslo_concurrency.lockutils [None req-52eee02e-c9d9-4bf2-8acd-8e37caf23f5e admin admin] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:02:11.559678 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: DEBUG oslo_concurrency.lockutils [None req-52eee02e-c9d9-4bf2-8acd-8e37caf23f5e admin admin] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:02:11.581895 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: INFO nova.api.openstack.requestlog [None req-52eee02e-c9d9-4bf2-8acd-8e37caf23f5e admin admin] 10.222.0.32 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.078538 May 30 12:02:11.582386 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: [pid: 103262|app: 0|req: 39/76] 10.222.0.32 () {60 vars in 1193 bytes} [Mon May 30 12:02:11 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:03:11.860959 dv-cinder-840512-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 30 12:03:11.861579 dv-cinder-840512-2-iscsi devstack@n-api.service[103260]: Mon May 30 12:03:11 2022 - graceful shutdown triggered... May 30 12:03:11.862024 dv-cinder-840512-2-iscsi devstack@n-api.service[103261]: Gracefully killing worker 1 (pid: 103261)... May 30 12:03:11.862392 dv-cinder-840512-2-iscsi devstack@n-api.service[103262]: Gracefully killing worker 2 (pid: 103262)... May 30 12:03:12.862752 dv-cinder-840512-2-iscsi devstack@n-api.service[103260]: worker 1 buried after 1 seconds May 30 12:03:12.862752 dv-cinder-840512-2-iscsi devstack@n-api.service[103260]: worker 2 buried after 1 seconds May 30 12:03:12.862752 dv-cinder-840512-2-iscsi devstack@n-api.service[103260]: goodbye to uWSGI. May 30 12:03:12.864916 dv-cinder-840512-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 30 12:03:12.865705 dv-cinder-840512-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 30 12:03:12.868497 dv-cinder-840512-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 30 12:03:12.883797 dv-cinder-840512-2-iscsi devstack@n-api.service[117651]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 30 12:03:12.901610 dv-cinder-840512-2-iscsi devstack@n-api.service[117651]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 30 12:03:12 2022] *** May 30 12:03:12.901828 dv-cinder-840512-2-iscsi devstack@n-api.service[117651]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 30 12:03:12.901970 dv-cinder-840512-2-iscsi devstack@n-api.service[117651]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 30 12:03:12.902097 dv-cinder-840512-2-iscsi devstack@n-api.service[117651]: nodename: dv-cinder-840512-2-iscsi May 30 12:03:12.902210 dv-cinder-840512-2-iscsi devstack@n-api.service[117651]: machine: x86_64 May 30 12:03:12.902321 dv-cinder-840512-2-iscsi devstack@n-api.service[117651]: clock source: unix May 30 12:03:12.902431 dv-cinder-840512-2-iscsi devstack@n-api.service[117651]: pcre jit disabled May 30 12:03:12.902541 dv-cinder-840512-2-iscsi devstack@n-api.service[117651]: detected number of CPU cores: 4 May 30 12:03:12.902662 dv-cinder-840512-2-iscsi devstack@n-api.service[117651]: current working directory: / May 30 12:03:12.902779 dv-cinder-840512-2-iscsi devstack@n-api.service[117651]: detected binary path: /usr/bin/uwsgi-core May 30 12:03:12.902899 dv-cinder-840512-2-iscsi devstack@n-api.service[117651]: your processes number limit is 47680 May 30 12:03:12.903045 dv-cinder-840512-2-iscsi devstack@n-api.service[117651]: your memory page size is 4096 bytes May 30 12:03:12.903193 dv-cinder-840512-2-iscsi devstack@n-api.service[117651]: detected max file descriptor number: 2048 May 30 12:03:12.903343 dv-cinder-840512-2-iscsi devstack@n-api.service[117651]: lock engine: pthread robust mutexes May 30 12:03:12.903665 dv-cinder-840512-2-iscsi devstack@n-api.service[117651]: thunder lock: enabled May 30 12:03:12.904016 dv-cinder-840512-2-iscsi devstack@n-api.service[117651]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 30 12:03:12.904289 dv-cinder-840512-2-iscsi devstack@n-api.service[117651]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 30 12:03:12.949713 dv-cinder-840512-2-iscsi devstack@n-api.service[117651]: Python main interpreter initialized at 0x559e0aae29c0 May 30 12:03:12.949713 dv-cinder-840512-2-iscsi devstack@n-api.service[117651]: python threads support enabled May 30 12:03:12.949713 dv-cinder-840512-2-iscsi devstack@n-api.service[117651]: your server socket listen backlog is limited to 100 connections May 30 12:03:12.949713 dv-cinder-840512-2-iscsi devstack@n-api.service[117651]: your mercy for graceful operations on workers is 90 seconds May 30 12:03:12.950183 dv-cinder-840512-2-iscsi devstack@n-api.service[117651]: mapped 403077 bytes (393 KB) for 2 cores May 30 12:03:12.950183 dv-cinder-840512-2-iscsi devstack@n-api.service[117651]: *** Operational MODE: preforking *** May 30 12:03:12.950411 dv-cinder-840512-2-iscsi devstack@n-api.service[117651]: *** uWSGI is running in multiple interpreter mode *** May 30 12:03:12.950411 dv-cinder-840512-2-iscsi devstack@n-api.service[117651]: spawned uWSGI master process (pid: 117651) May 30 12:03:12.950624 dv-cinder-840512-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 30 12:03:12.967446 dv-cinder-840512-2-iscsi devstack@n-api.service[117651]: spawned uWSGI worker 1 (pid: 117670, cores: 1) May 30 12:03:12.967446 dv-cinder-840512-2-iscsi devstack@n-api.service[117651]: spawned uWSGI worker 2 (pid: 117671, cores: 1) May 30 12:03:12.967446 dv-cinder-840512-2-iscsi devstack@n-api.service[117651]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 30 12:03:14.303033 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 30 12:03:14.310822 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 30 12:03:15.141282 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 30 12:03:15.141282 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: from cryptography.utils import int_from_bytes May 30 12:03:15.141601 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 30 12:03:15.141601 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: from cryptography.utils import int_from_bytes May 30 12:03:15.157515 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 30 12:03:15.157515 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: from cryptography.utils import int_from_bytes May 30 12:03:15.157857 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 30 12:03:15.157857 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: from cryptography.utils import int_from_bytes May 30 12:03:17.576731 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 30 12:03:17.577283 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 30 12:03:17.577524 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 30 12:03:17.577888 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 30 12:03:17.578151 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 30 12:03:17.578536 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.578865 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.579190 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.579510 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.579840 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.580153 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.580510 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.580833 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.581165 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.581431 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.581752 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.582084 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-840512-2-iscsi {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.582408 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.583316 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.583643 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.583986 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.584392 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.584724 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.585039 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.585552 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.586888 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.586888 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.586888 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.587134 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.587294 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.587544 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.587877 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.588208 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.588536 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.588848 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.589270 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-840512-2-iscsi {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.589591 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.589893 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.590224 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.590641 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.591055 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.591376 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.591669 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.591996 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.592336 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.592693 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.593525 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.593525 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.593711 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.593913 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.594232 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.594541 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.594863 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.595175 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.595488 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.595742 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.596055 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.596406 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.596732 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.597058 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.597314 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.597569 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.597896 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.598220 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.599291 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.599681 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.599998 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.600337 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.600654 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.600967 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.601281 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.601590 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.601915 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.602235 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.602565 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.602876 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.603205 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.603618 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.32 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.603873 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.32 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.604208 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.604562 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.604877 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.605188 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.605510 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.605928 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.606148 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.606460 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.606767 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.607088 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.607425 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.607733 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.607988 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.608315 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.608624 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.608943 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.609255 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.609562 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.609869 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.610172 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.610479 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.610787 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.611095 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.611403 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.611712 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.612019 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.612362 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.612673 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.612982 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.613303 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.613627 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.613966 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.614279 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.614589 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.614894 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.615217 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.615525 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.615835 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.616182 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.616485 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.616795 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.617114 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.617421 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.617728 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.618049 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.618353 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.618660 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.618978 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.619286 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.619592 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.619899 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.620225 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.620533 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.620839 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.621143 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.621245 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 30 12:03:17.621680 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.621782 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 30 12:03:17.621871 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.622009 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 30 12:03:17.622110 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.622356 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.622462 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 30 12:03:17.622624 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 30 12:03:17.622725 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.622964 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.623056 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.623272 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.623381 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.623720 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.623836 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.623925 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.624010 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.624277 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.624378 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.624616 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.624707 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.624936 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.625041 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.625260 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.625362 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.625592 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.625692 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.625863 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.626005 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.626187 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.626293 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.626519 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.626621 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-840512-2-iscsi {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.626845 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.626957 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.627159 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.627250 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.627475 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.627579 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.627788 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.627890 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.628098 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.628204 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.628443 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.628535 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.628773 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.628971 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.629092 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.629293 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.629408 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.629641 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.629759 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.629957 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.630050 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.630276 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.630376 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.630621 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.630729 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.630944 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.631046 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.631262 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.631421 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.631589 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.631791 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.631892 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.632140 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.632245 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.632468 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.632561 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.632802 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.632940 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-840512-2-iscsi {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.633133 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.633260 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.633451 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.633704 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.633800 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.633880 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.634070 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.634327 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.634458 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.634629 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.634722 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.634941 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.635036 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.635268 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.635370 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.635594 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.635687 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.635914 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.636112 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.636258 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.636363 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.636566 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.636681 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.636878 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.636976 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.637219 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.637315 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.637525 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.637627 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.637838 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.637942 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.638152 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.638254 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.638469 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.638562 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.638778 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.638880 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.639089 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.639193 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.639345 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.639451 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.639658 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.639766 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.640001 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.640099 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.640311 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.640421 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.640626 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.640730 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.640895 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.640996 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.641151 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.641246 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.641475 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.641570 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.641801 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.641903 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.642118 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.642223 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.642427 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.642522 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.642741 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.642834 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.643052 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.643146 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.643364 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.643466 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.643672 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.643774 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.643979 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.644085 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.644345 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.644454 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.644619 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.644708 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.645744 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.645938 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.646081 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.646271 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.646415 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.646750 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.646902 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.647058 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.647208 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.32 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.647351 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.647503 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.32 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.647653 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.647803 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.647954 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.648115 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.648245 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.648336 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.648432 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.648617 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.648747 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.648956 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.649049 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.649283 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.649383 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.649596 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.649692 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.649910 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.650004 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.650223 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.650317 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.650548 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.650643 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.650888 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.650997 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.651200 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.651296 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.651455 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.651559 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.651761 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.651854 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.652069 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.652195 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.652431 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.652556 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.652741 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.652843 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.653053 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.653154 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.653364 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.653466 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.653669 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.653778 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.653971 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.654080 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.654280 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.654383 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.654591 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.654691 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.654896 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.654989 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.655205 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.655298 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.655513 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.655608 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.655846 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.655941 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.656129 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.656373 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.656472 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.656561 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.656751 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.656846 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.657081 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.657175 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.657393 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.657488 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.657705 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.657808 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.658017 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.658120 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.658327 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.658435 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.658652 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.658746 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.658967 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.659061 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.659278 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.659386 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.659612 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.659810 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.659899 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.659983 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.660233 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.660347 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.660550 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.660644 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.660932 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.661655 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.661846 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.661945 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.662075 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.662196 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.662410 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.662515 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.662722 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.662818 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.663038 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.663146 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.663362 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.663464 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.663671 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.663773 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.663990 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.664079 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.664355 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.664470 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.664671 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.664773 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.664984 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.665074 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.665295 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.665404 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.665606 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.665700 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.665914 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.666014 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.666233 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.666352 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.666554 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.666660 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.666866 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.666959 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.667177 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.667284 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.667489 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.667590 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.667803 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.667894 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:03:17.668127 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.668239 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.668469 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.668564 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.668797 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.668891 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.669112 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.669220 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.669435 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.669536 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.669745 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.669839 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.670065 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.670159 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.670398 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.670491 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.670720 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.670821 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.671035 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.671135 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.671351 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.671444 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.671668 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.671769 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.671980 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.672071 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.672329 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.672424 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.672646 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.672752 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.672956 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.673057 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.673266 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.673360 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.673581 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.673689 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.673902 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.673998 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.674217 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.674309 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.674537 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.674646 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.674841 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.674940 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.675158 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.675259 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.675469 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.675564 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.675776 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.675869 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.676082 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.676216 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.676461 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.676563 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.676798 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.676904 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.677113 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.677266 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.677438 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.677600 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.677768 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.677920 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.678125 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.678233 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.678385 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.678562 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.678714 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.678905 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.679028 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.679225 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.679326 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.679550 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.679651 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.679869 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.679964 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.680211 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.680312 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.680533 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.680639 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.680853 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.680953 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.681171 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.681273 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.681515 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.681607 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.681830 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.681922 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.682147 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.682242 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.682461 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.682561 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.682775 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.682883 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.683092 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.683192 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.683409 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.683503 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.683721 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.683822 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.684035 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.684130 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.684375 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.684476 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.684686 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.684794 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.684998 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.685090 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.685308 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.685399 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.685625 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.685797 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.685941 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.686035 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.686255 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.686356 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.686565 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.686663 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.686889 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.687030 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.687201 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.687316 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.687518 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.687784 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.687888 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.688128 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.688265 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.688471 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.688580 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.688791 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.688885 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.689104 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.689205 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.689426 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.689529 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.689744 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.689835 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.690056 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.690149 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.690386 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.690480 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.690717 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.690829 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.691202 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.691306 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.691306 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.691473 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.691614 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.691715 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.691930 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.692047 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.692293 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.692493 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.692601 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.692830 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.692963 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.693162 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.693261 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.693488 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.693592 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.693794 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.693896 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.694102 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.694196 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.694421 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.694516 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.694745 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.694850 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.695055 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.695156 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.695372 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.695475 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.695682 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.695785 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.696009 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.696110 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.696350 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.696467 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.696662 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.696802 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.696976 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.697091 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.697281 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.697391 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.697596 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.697695 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.697910 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.698010 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.698224 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.698331 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.698536 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.698635 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.698849 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.698942 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.699160 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.699262 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.699489 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.699597 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.699807 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.699908 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.700116 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.700242 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.700450 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.700552 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.700759 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.700851 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.701074 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.701163 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.701386 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.701487 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.701691 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.701783 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.702006 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.702100 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.702317 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.702410 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.702629 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.702722 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.702943 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.703102 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.703258 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.703425 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.703568 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.703726 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.703868 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.704011 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.704188 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.704298 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.704468 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.704574 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.704774 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.704877 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.705080 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.705198 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.705393 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.705543 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.705704 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.705831 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.706010 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.706162 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.706322 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.706481 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.706627 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.706808 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.706945 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.707124 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.707248 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.707448 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.707560 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.708409 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.708525 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.708730 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.708893 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.709037 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.709133 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.709345 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.709439 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.709671 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.709813 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.709983 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.710086 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.710289 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.710384 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.710595 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.710699 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.710906 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.711008 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.711213 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.711310 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.711516 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.711625 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.711826 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.711921 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.712150 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.712275 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.712490 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.712595 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.712796 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.712891 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.713111 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.713215 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.713413 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.713508 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.713719 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.713820 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.714025 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.714118 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.714339 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.714443 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.714647 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.714761 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.714950 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.715062 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.715252 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.715356 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.715560 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.715737 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.715889 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.716059 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.716243 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.716337 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.716493 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.716588 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.716798 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.716969 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.717104 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.717224 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.717407 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.717525 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.717757 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.717875 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.718061 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.718163 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.718375 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.718475 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.718689 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.718785 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.719014 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.719115 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.719330 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.719423 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.719641 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.719735 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.719950 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.720050 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.720295 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.720405 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.720603 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.720705 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.720921 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.721016 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.721235 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.721356 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.721553 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.721648 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.721861 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.721953 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.722168 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.722275 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.722493 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.722586 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.722805 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.722898 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.723113 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.723210 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.723478 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.723699 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.723802 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.724048 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.724144 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.724419 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.724516 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.724733 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.724831 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.725053 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.725160 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.725366 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.725457 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.725680 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.725775 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.725992 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.726084 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.726308 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.726399 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.726621 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.726710 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.726940 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.727047 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.727271 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.727385 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.727564 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.727658 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.727882 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.728002 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.728208 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.728319 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.728527 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.728627 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.728840 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.728946 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.729148 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.729245 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.729466 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.729560 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.729777 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.729871 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.730086 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.730180 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.730394 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.730488 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.730699 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.730793 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.731013 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.731113 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.731335 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.731592 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.731754 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.731934 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.732068 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.732282 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.732406 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.732612 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.732723 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.732940 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.733042 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.733267 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.733362 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.733605 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.733700 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.733921 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.734020 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.734235 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.734337 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.734583 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.734691 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.734903 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.735006 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.735220 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.735337 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.735530 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.735633 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.735849 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.735965 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.736152 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.736271 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.736484 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.736580 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.736795 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.736932 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.737105 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.737205 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.737476 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.737607 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.737701 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.737790 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.738024 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.738118 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.738342 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.738432 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.738644 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.738764 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.739468 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.739616 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.739784 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.740059 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.740220 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.740399 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.740495 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.740747 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.740849 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.741056 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.741167 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.741366 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.741576 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.741674 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.741751 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.742015 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.742124 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.742328 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.742431 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.742666 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.742758 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.742987 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.743091 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.743302 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.743393 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.743629 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.743723 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.743942 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.744043 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.744282 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.744378 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.744604 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.744706 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.744930 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.745043 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.745260 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.745364 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.745542 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.745636 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.745914 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.746021 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.746161 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.746264 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.746477 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.746571 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.746790 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.746885 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.747109 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.747204 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.747425 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.747532 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.747732 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.747843 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.748051 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.748204 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.748386 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.748502 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.748708 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.748810 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.749021 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.749115 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.749327 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.749434 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.749630 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.749724 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.749945 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.750039 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.750255 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.750358 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.750562 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.750660 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.750871 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.750962 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.751175 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.751278 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.751480 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.751580 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.751800 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.751958 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.752114 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.752233 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.752436 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.752549 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.752753 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.752848 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.753069 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.753166 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.753379 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.753491 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.753685 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.753795 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.754009 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.754105 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.754322 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.754417 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.754683 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.754794 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.754995 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.755095 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.755301 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.755403 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.755609 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.755718 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.755925 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.756034 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.756276 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.756373 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.756600 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.756711 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.756910 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.757007 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.757227 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.757323 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.757557 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.757673 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.757834 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.757930 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.758148 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.758287 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.758463 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.758564 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.758770 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.758881 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.759078 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.759187 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.759381 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.759483 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.759686 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.759787 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.759993 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.760093 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.760323 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.760437 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.760629 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.760739 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.760940 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.761043 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.761244 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.761365 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.761549 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.761649 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.761852 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.761969 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.762178 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.762299 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.762485 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.762590 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.762809 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.762914 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.763120 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.763214 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.763426 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.763521 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.763733 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.763838 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.764038 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.764148 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.764409 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.764520 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.764722 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.764818 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.765057 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.765159 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.765375 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.765483 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.765696 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.765792 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.766009 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.766102 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.766322 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.766433 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.766646 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.766739 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.766962 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.767060 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.767340 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.767457 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.767592 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.767694 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.767908 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.768009 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.768250 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.768359 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.768564 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.768714 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.768880 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.768973 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.769194 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.769289 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.769509 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.769611 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.769824 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.770705 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.770922 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.771019 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.771238 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.771564 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.771737 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.771901 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.772062 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.772248 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.772410 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.772570 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.772730 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.772888 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.773044 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.773210 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.773361 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.773529 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.773679 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.773850 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.773978 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.774165 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.774312 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.774479 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.774631 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.774792 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.774948 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.775126 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.775276 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.775453 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.775575 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.775765 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.775898 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.776107 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.776233 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.776455 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.776650 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.776776 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.776970 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.777093 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.777288 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.777411 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.777650 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.777762 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.777919 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.778083 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.778235 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.778397 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.778557 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.778733 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.778876 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.779041 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.779187 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.779363 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.779613 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.779708 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.779932 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.780025 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.780273 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.780387 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.780591 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.780685 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.780901 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.780994 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.781211 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.781317 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.781524 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.781616 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.781840 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.781933 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.782148 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.782248 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.782461 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.782566 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.782768 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.782862 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.783095 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.783199 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.783406 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.783507 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.783726 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.783817 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.784147 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.784273 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.784487 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.784580 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.784800 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.784907 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.785221 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.785320 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.785535 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.785627 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.785924 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.786045 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.786242 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.786435 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.786603 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.786760 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.786871 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.787093 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.787188 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.787404 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.787506 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.787728 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.787878 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.788044 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.788139 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.788404 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.788498 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.788736 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.788858 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.789054 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.789155 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.789373 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.789472 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.789682 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.789784 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.790011 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.790217 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.790340 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.790575 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.790688 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.790947 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.791070 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.791223 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.791387 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.791552 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.791716 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.791876 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.792058 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.792249 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.792400 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.792504 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.792717 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.792830 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.793031 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.793133 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.793343 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.793438 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.793662 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.793757 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.793976 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.794145 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.794309 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.794461 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.794613 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.794763 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.794913 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.795066 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.795207 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.795357 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.795511 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.795671 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.795819 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.795970 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.796121 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.796265 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.796429 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.796523 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.796738 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.796834 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.797044 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.797149 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.797359 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.797453 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.797666 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.797766 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.797972 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.798080 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.798280 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.798373 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.798583 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.798721 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.798897 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.799004 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.799203 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.799315 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.799511 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.799605 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.799814 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.799915 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.800119 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.800250 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.800514 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.800620 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.800826 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.800919 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.801152 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.801251 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.802004 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.802130 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.802340 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.802539 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.802659 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.802856 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.802987 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.803179 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.803319 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.803497 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.803719 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.803848 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.804047 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.804271 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.804403 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.804509 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.804714 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.804808 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.805024 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.805127 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.805340 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.805639 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.805777 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.805952 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.806044 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.806262 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.806358 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.806577 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.806678 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.806886 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.806982 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.807194 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.807295 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.807501 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.807596 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.807823 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.807923 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.808131 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.808262 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.808479 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.808573 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.808792 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.808894 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.809101 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.809194 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.809412 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.809515 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.809720 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.809828 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.810032 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.810132 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.810346 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.810439 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.810661 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.810763 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.810975 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.811070 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.811288 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.811381 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.811602 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.811696 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.811915 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.812043 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.812248 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.812371 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.812572 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.812674 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.813085 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.813204 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.813204 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.813364 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.813526 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.813672 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.813846 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.813947 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.814164 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.814312 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.814480 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.814573 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.814793 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.814894 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.815103 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.815204 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.815420 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.815514 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.815738 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.815867 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.816072 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.816328 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.816443 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.816663 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.816757 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.816983 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.817762 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.817876 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.818095 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.818228 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.818464 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.818558 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.818784 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.818927 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.819104 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.819206 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.819422 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.819529 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.819738 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.819832 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.820051 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.820203 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.820404 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.820500 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.820723 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.820826 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.821053 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.821154 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.821394 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.821532 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.821714 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.821831 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.822035 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.822129 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.822343 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.822454 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.822653 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.822748 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.822963 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.823057 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.823277 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.823371 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.823604 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.823759 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.823911 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.824012 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.824240 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.824386 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.824551 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.824654 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.824864 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.824970 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.825173 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.825268 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.825487 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.825589 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.825794 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.825896 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.826107 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.826251 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.826419 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.826524 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.826719 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.826835 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.827039 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.827198 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.827352 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.827503 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.827645 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.827799 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.827942 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.828038 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.828248 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.828414 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.828567 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.828717 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.828868 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.829023 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.829175 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.829449 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.829606 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.829742 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.829833 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.830047 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.830141 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.830380 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.830492 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.830715 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.830809 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.831032 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.831132 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.831356 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.831462 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.831667 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.831760 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.831988 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.832089 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.832322 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.832432 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.832658 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.832755 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.832978 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.833081 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.833307 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.833429 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.833622 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.833768 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.833959 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.834090 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.834276 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.834404 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.834591 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.834733 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.834906 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.835048 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.835223 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.835542 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.835643 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.835855 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.835959 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.836247 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.836389 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.836610 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.836952 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.837286 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.837575 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.837908 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.838223 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.838341 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.838538 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.838664 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.838862 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.839002 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.839180 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.839331 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.839503 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.839661 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.839803 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.839987 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.840121 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.840333 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.840465 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.840673 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.840780 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.840992 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.841093 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.841310 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.841404 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.841631 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.841734 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.841948 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.842042 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.842265 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.842358 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.842580 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.842684 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.842898 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.843001 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.843208 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.843339 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.843520 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.843624 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.843830 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.843936 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.844140 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.844297 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.844482 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.844620 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.844792 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.844895 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.845108 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.845210 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.845416 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.845510 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.845738 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.845831 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.846048 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.846178 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.846363 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.846457 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.846711 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.846804 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.846959 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 30 12:03:17.847122 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.847352 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.847658 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.847979 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.848363 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.848801 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.849144 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.849435 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.849789 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.850115 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.850659 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.851000 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.851330 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.851674 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.852015 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.852361 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.852674 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.852986 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.853317 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.853638 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.853955 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.854272 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.854598 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.854907 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.855222 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.855538 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.855859 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.856243 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.856510 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.856826 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.857148 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.857512 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.857782 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.858131 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.858457 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.858780 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.859100 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.859425 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.859741 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.860062 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.860415 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.860734 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.861056 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.861393 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.861712 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.862023 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.862455 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.862774 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.863104 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.863428 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.863744 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.864642 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.865028 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.865301 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.865606 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.865923 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.866264 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.866610 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.866945 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.867283 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.867592 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.867905 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.868238 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.868556 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.868879 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.869195 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.869507 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.869815 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.870130 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.870443 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.870749 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.871059 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.871369 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.871681 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.871988 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.872322 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.872633 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.872942 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.873253 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.873562 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.873876 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.874184 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.874496 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.874804 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.875114 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.875421 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.875762 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.876101 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.876452 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.876784 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.877100 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.877431 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.877746 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.878074 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.878400 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.878724 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.879038 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.879379 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.880282 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.880606 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.880924 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.881245 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.881564 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.881881 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.882214 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.882545 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.882856 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.883419 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.883520 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.883819 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.884837 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.884837 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.887525 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.887525 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.887525 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.887525 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.887525 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.887525 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.887525 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.888875 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.888875 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.888875 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.888875 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.889275 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.889437 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.889796 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.890116 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.890470 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.890813 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.891153 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.891450 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.891765 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:03:17.892017 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 30 12:03:17.909047 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO dbcounter [None req-42845688-c8f2-49ef-b9bc-6e55c5c25bfd None None] Registered counter for database nova_api May 30 12:03:17.930792 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_db.sqlalchemy.engines [None req-42845688-c8f2-49ef-b9bc-6e55c5c25bfd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117671) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 30 12:03:17.937559 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writer thread running {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 30 12:03:17.953914 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO dbcounter [None req-00fff3d2-37ce-466d-905f-7e469dd3df94 None None] Registered counter for database nova_api May 30 12:03:17.977093 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_db.sqlalchemy.engines [None req-00fff3d2-37ce-466d-905f-7e469dd3df94 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117670) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 30 12:03:17.984139 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writer thread running {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 30 12:03:17.996834 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.context [None req-42845688-c8f2-49ef-b9bc-6e55c5c25bfd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),aeb16e79-014c-4213-8687-12281f6933dc(cell1) {{(pid=117671) load_cells /opt/stack/nova/nova/context.py:464}} May 30 12:03:18.001205 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-42845688-c8f2-49ef-b9bc-6e55c5c25bfd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:03:18.002920 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-42845688-c8f2-49ef-b9bc-6e55c5c25bfd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:03:18.003774 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-42845688-c8f2-49ef-b9bc-6e55c5c25bfd None None] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:03:18.006423 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-42845688-c8f2-49ef-b9bc-6e55c5c25bfd None None] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:03:18.008557 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO dbcounter [None req-42845688-c8f2-49ef-b9bc-6e55c5c25bfd None None] Registered counter for database nova_cell0 May 30 12:03:18.012981 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO dbcounter [None req-42845688-c8f2-49ef-b9bc-6e55c5c25bfd None None] Registered counter for database nova_cell1 May 30 12:03:18.021277 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_db.sqlalchemy.engines [None req-42845688-c8f2-49ef-b9bc-6e55c5c25bfd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117671) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 30 12:03:18.026787 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writer thread running {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 30 12:03:18.027459 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_db.sqlalchemy.engines [None req-42845688-c8f2-49ef-b9bc-6e55c5c25bfd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117671) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 30 12:03:18.045594 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.context [None req-00fff3d2-37ce-466d-905f-7e469dd3df94 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),aeb16e79-014c-4213-8687-12281f6933dc(cell1) {{(pid=117670) load_cells /opt/stack/nova/nova/context.py:464}} May 30 12:03:18.049773 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-00fff3d2-37ce-466d-905f-7e469dd3df94 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:03:18.051425 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-00fff3d2-37ce-466d-905f-7e469dd3df94 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:03:18.052311 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-00fff3d2-37ce-466d-905f-7e469dd3df94 None None] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:03:18.054301 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-00fff3d2-37ce-466d-905f-7e469dd3df94 None None] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:03:18.056334 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO dbcounter [None req-00fff3d2-37ce-466d-905f-7e469dd3df94 None None] Registered counter for database nova_cell0 May 30 12:03:18.062790 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO dbcounter [None req-00fff3d2-37ce-466d-905f-7e469dd3df94 None None] Registered counter for database nova_cell1 May 30 12:03:18.071163 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_db.sqlalchemy.engines [None req-00fff3d2-37ce-466d-905f-7e469dd3df94 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117670) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 30 12:03:18.076397 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_db.sqlalchemy.engines [None req-00fff3d2-37ce-466d-905f-7e469dd3df94 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117670) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 30 12:03:18.078136 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writer thread running {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 30 12:03:18.174213 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writer thread running {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 30 12:03:18.184486 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO dbcounter [None req-42845688-c8f2-49ef-b9bc-6e55c5c25bfd None None] Registered counter for database nova_cell0 May 30 12:03:18.195218 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_db.sqlalchemy.engines [None req-42845688-c8f2-49ef-b9bc-6e55c5c25bfd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117671) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 30 12:03:18.200313 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writer thread running {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 30 12:03:18.233230 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writer thread running {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 30 12:03:18.243886 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO dbcounter [None req-00fff3d2-37ce-466d-905f-7e469dd3df94 None None] Registered counter for database nova_cell0 May 30 12:03:18.251403 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_db.sqlalchemy.engines [None req-00fff3d2-37ce-466d-905f-7e469dd3df94 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117670) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 30 12:03:18.257299 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writer thread running {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 30 12:03:18.647981 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: WARNING keystonemiddleware.auth_token [None req-42845688-c8f2-49ef-b9bc-6e55c5c25bfd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 30 12:03:18.655506 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: WARNING keystonemiddleware.auth_token [None req-42845688-c8f2-49ef-b9bc-6e55c5c25bfd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 30 12:03:18.716385 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: WARNING keystonemiddleware.auth_token [None req-00fff3d2-37ce-466d-905f-7e469dd3df94 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 30 12:03:18.724096 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: WARNING keystonemiddleware.auth_token [None req-00fff3d2-37ce-466d-905f-7e469dd3df94 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 30 12:03:18.885681 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: WARNING keystonemiddleware.auth_token [None req-42845688-c8f2-49ef-b9bc-6e55c5c25bfd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 30 12:03:18.891628 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: WARNING keystonemiddleware.auth_token [None req-42845688-c8f2-49ef-b9bc-6e55c5c25bfd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 30 12:03:18.897769 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559e0aae29c0 pid: 117671 (default app) May 30 12:03:18.951725 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: WARNING keystonemiddleware.auth_token [None req-00fff3d2-37ce-466d-905f-7e469dd3df94 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 30 12:03:18.958014 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: WARNING keystonemiddleware.auth_token [None req-00fff3d2-37ce-466d-905f-7e469dd3df94 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 30 12:03:18.963210 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559e0aae29c0 pid: 117670 (default app) May 30 12:04:01.522351 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_api:SELECT=3 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:04:01.523447 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell1:SELECT=3 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:04:01.524232 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell0:SELECT=3 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:04:01.525273 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell0:SELECT=3 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:04:03.162233 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-dc2185c7-f5fa-46bd-ac93-376af215e60c tempest-VolumesNegativeTest-1972169753 tempest-VolumesNegativeTest-1972169753-project] Action: 'create', calling method: .version_select at 0x7f0efa7e7280>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1782976308", "metadata": {"Type": "work"}}} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:04:03.182187 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-dc2185c7-f5fa-46bd-ac93-376af215e60c tempest-VolumesNegativeTest-1972169753 tempest-VolumesNegativeTest-1972169753-project] Request method failure captured: May 30 12:04:03.182187 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 30 12:04:03.182187 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Accept: application/json May 30 12:04:03.182187 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Accept-Encoding: identity May 30 12:04:03.182187 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Connection: close May 30 12:04:03.182187 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Content-Length: 122 May 30 12:04:03.182187 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Content-Type: application/json May 30 12:04:03.182187 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Host: 10.222.0.32 May 30 12:04:03.182187 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Openstack-System-Scope: None May 30 12:04:03.182187 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: User-Agent: python-urllib3/1.26.9 May 30 12:04:03.182187 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Auth-Token: gAAAAABilLKxmXQ8Hy3DvhiUz3YEb6eyaym-twcAxxEpIb-OU_g6wJdDNIdEefDsj58MRQ8ASL8tNjAhDhgyIoJQdFdLnADVm3mj74pR-2J-r9DVffQlL8-vKbCexZABdDN5JeoNlfKQKO3kc-gMBiOqf6JHIvkKw9poic4Dl8jDaIm_E7DuWo0 May 30 12:04:03.182187 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Domain-Id: None May 30 12:04:03.182187 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Domain-Name: None May 30 12:04:03.182187 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Identity-Status: Confirmed May 30 12:04:03.182187 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Is-Admin-Project: True May 30 12:04:03.182187 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Domain-Id: default May 30 12:04:03.182187 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Domain-Name: Default May 30 12:04:03.182187 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Id: af0e2e127e9941cc8118d8f77f419f64 May 30 12:04:03.182187 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Name: tempest-VolumesNegativeTest-1972169753 May 30 12:04:03.182187 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Role: reader,member May 30 12:04:03.182187 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Roles: reader,member May 30 12:04:03.183968 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/af0e2e127e9941cc8118d8f77f419f64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/af0e2e127e9941cc8118d8f77f419f64"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/af0e2e127e9941cc8118d8f77f419f64"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_af0e2e127e9941cc8118d8f77f419f64", "adminURL": "http://10.222.0.32:8080"}]}] May 30 12:04:03.183968 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Tenant: tempest-VolumesNegativeTest-1972169753 May 30 12:04:03.183968 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Tenant-Id: af0e2e127e9941cc8118d8f77f419f64 May 30 12:04:03.183968 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Tenant-Name: tempest-VolumesNegativeTest-1972169753 May 30 12:04:03.183968 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User: tempest-VolumesNegativeTest-1972169753-project May 30 12:04:03.183968 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Domain-Id: default May 30 12:04:03.183968 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Domain-Name: Default May 30 12:04:03.183968 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Id: 949c0230b6304516a2c22abea205bc43 May 30 12:04:03.183968 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Name: tempest-VolumesNegativeTest-1972169753-project May 30 12:04:03.183968 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: May 30 12:04:03.183968 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1782976308", "metadata": {"Type": "work"}}} May 30 12:04:03.183968 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: method: May 30 12:04:03.183968 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 30 12:04:03.184997 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1782976308', 'metadata': {'Type': 'work'}}}} May 30 12:04:03.184997 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:04:03.184997 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:04:03.184997 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 30 12:04:03.184997 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 30 12:04:03.184997 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 30 12:04:03.184997 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise error May 30 12:04:03.184997 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 30 12:04:03.184997 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:04:03.184997 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 30 12:04:03.184997 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 30 12:04:03.184997 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:04:03.184997 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi On instance['volume']: May 30 12:04:03.184997 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi '#$%' May 30 12:04:03.184997 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:04:03.184997 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:04:03.184997 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:04:03.184997 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:04:03.184997 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:04:03.184997 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:04:03.184997 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:04:03.184997 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:04:03.186618 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 30 12:04:03.186618 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 30 12:04:03.186618 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:04:03.186618 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:04:03.186618 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 30 12:04:03.186618 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 30 12:04:03.186618 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 30 12:04:03.186618 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 30 12:04:03.186618 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 30 12:04:03.186618 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 30 12:04:03.186618 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 30 12:04:03.186618 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:04:03.186618 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:04:03.186618 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:04:03.186618 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:04:03.186618 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:04:03.186618 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:04:03.186618 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 30 12:04:03.186618 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 30 12:04:03.187979 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 30 12:04:03.187979 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:04:03.189307 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-dc2185c7-f5fa-46bd-ac93-376af215e60c tempest-VolumesNegativeTest-1972169753 tempest-VolumesNegativeTest-1972169753-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:04:03.191278 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-dc2185c7-f5fa-46bd-ac93-376af215e60c tempest-VolumesNegativeTest-1972169753 tempest-VolumesNegativeTest-1972169753-project] 10.222.0.32 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.677808 May 30 12:04:03.192995 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 1/1] 10.222.0.32 () {60 vars in 1155 bytes} [Mon May 30 12:04:01 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1681 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 30 12:04:03.205371 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_api:SELECT=3 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:04:03.206743 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell0:SELECT=3 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:04:03.208945 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell1:SELECT=3 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:04:03.211688 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell0:SELECT=3 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:04:03.754682 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-61c6f26c-329c-450b-affe-4b3339785595 tempest-VolumesNegativeTest-1972169753 tempest-VolumesNegativeTest-1972169753-project] Action: 'create', calling method: .version_select at 0x7f0efa8a3e50>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2003985898", "metadata": {"Type": "work"}}} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:04:03.764594 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-61c6f26c-329c-450b-affe-4b3339785595 tempest-VolumesNegativeTest-1972169753 tempest-VolumesNegativeTest-1972169753-project] Request method failure captured: May 30 12:04:03.764594 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 30 12:04:03.764594 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Accept: application/json May 30 12:04:03.764594 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Accept-Encoding: identity May 30 12:04:03.764594 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Connection: close May 30 12:04:03.764594 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Content-Length: 120 May 30 12:04:03.764594 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Content-Type: application/json May 30 12:04:03.764594 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Host: 10.222.0.32 May 30 12:04:03.764594 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Openstack-System-Scope: None May 30 12:04:03.764594 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: User-Agent: python-urllib3/1.26.9 May 30 12:04:03.764594 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Auth-Token: gAAAAABilLKxmXQ8Hy3DvhiUz3YEb6eyaym-twcAxxEpIb-OU_g6wJdDNIdEefDsj58MRQ8ASL8tNjAhDhgyIoJQdFdLnADVm3mj74pR-2J-r9DVffQlL8-vKbCexZABdDN5JeoNlfKQKO3kc-gMBiOqf6JHIvkKw9poic4Dl8jDaIm_E7DuWo0 May 30 12:04:03.764594 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Domain-Id: None May 30 12:04:03.764594 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Domain-Name: None May 30 12:04:03.764594 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Identity-Status: Confirmed May 30 12:04:03.764594 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Is-Admin-Project: True May 30 12:04:03.764594 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Domain-Id: default May 30 12:04:03.764594 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Domain-Name: Default May 30 12:04:03.764594 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Id: af0e2e127e9941cc8118d8f77f419f64 May 30 12:04:03.764594 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Name: tempest-VolumesNegativeTest-1972169753 May 30 12:04:03.764594 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Role: reader,member May 30 12:04:03.764594 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Roles: reader,member May 30 12:04:03.766026 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/af0e2e127e9941cc8118d8f77f419f64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/af0e2e127e9941cc8118d8f77f419f64"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/af0e2e127e9941cc8118d8f77f419f64"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_af0e2e127e9941cc8118d8f77f419f64", "adminURL": "http://10.222.0.32:8080"}]}] May 30 12:04:03.766026 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant: tempest-VolumesNegativeTest-1972169753 May 30 12:04:03.766026 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant-Id: af0e2e127e9941cc8118d8f77f419f64 May 30 12:04:03.766026 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant-Name: tempest-VolumesNegativeTest-1972169753 May 30 12:04:03.766026 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User: tempest-VolumesNegativeTest-1972169753-project May 30 12:04:03.766026 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Domain-Id: default May 30 12:04:03.766026 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Domain-Name: Default May 30 12:04:03.766026 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Id: 949c0230b6304516a2c22abea205bc43 May 30 12:04:03.766026 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Name: tempest-VolumesNegativeTest-1972169753-project May 30 12:04:03.766026 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: May 30 12:04:03.766026 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2003985898", "metadata": {"Type": "work"}}} May 30 12:04:03.766026 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: method: May 30 12:04:03.766026 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 30 12:04:03.766838 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2003985898', 'metadata': {'Type': 'work'}}}} May 30 12:04:03.766838 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:04:03.766838 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:04:03.766838 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 30 12:04:03.766838 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 30 12:04:03.766838 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 30 12:04:03.766838 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise error May 30 12:04:03.766838 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 30 12:04:03.766838 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:04:03.766838 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 30 12:04:03.766838 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 30 12:04:03.766838 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:04:03.766838 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi On instance['volume']: May 30 12:04:03.766838 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi '0' May 30 12:04:03.766838 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:04:03.766838 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:04:03.766838 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:04:03.766838 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:04:03.766838 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:04:03.766838 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:04:03.766838 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:04:03.766838 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:04:03.768125 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 30 12:04:03.768125 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 30 12:04:03.768125 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:04:03.768125 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:04:03.768125 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 30 12:04:03.768125 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 30 12:04:03.768125 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 30 12:04:03.768125 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 30 12:04:03.768125 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 30 12:04:03.768125 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 30 12:04:03.768125 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 30 12:04:03.768125 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:04:03.768125 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:04:03.768125 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:04:03.768125 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:04:03.768125 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:04:03.768125 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:04:03.768125 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 30 12:04:03.768125 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 30 12:04:03.770475 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 30 12:04:03.770475 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:04:03.771540 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-61c6f26c-329c-450b-affe-4b3339785595 tempest-VolumesNegativeTest-1972169753 tempest-VolumesNegativeTest-1972169753-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:04:03.774871 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-61c6f26c-329c-450b-affe-4b3339785595 tempest-VolumesNegativeTest-1972169753 tempest-VolumesNegativeTest-1972169753-project] 10.222.0.32 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.574690 May 30 12:04:03.777479 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 1/2] 10.222.0.32 () {60 vars in 1155 bytes} [Mon May 30 12:04:03 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 580 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 30 12:04:03.786644 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-a4397629-5021-46f4-b21f-ada72a9242ca tempest-VolumesNegativeTest-1972169753 tempest-VolumesNegativeTest-1972169753-project] Action: 'create', calling method: .version_select at 0x7f0efa6865e0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-506637278", "metadata": {"Type": "work"}}} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:04:03.789847 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-a4397629-5021-46f4-b21f-ada72a9242ca tempest-VolumesNegativeTest-1972169753 tempest-VolumesNegativeTest-1972169753-project] Request method failure captured: May 30 12:04:03.789847 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 30 12:04:03.789847 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Accept: application/json May 30 12:04:03.789847 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Accept-Encoding: identity May 30 12:04:03.789847 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Connection: close May 30 12:04:03.789847 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Content-Length: 118 May 30 12:04:03.789847 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Content-Type: application/json May 30 12:04:03.789847 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Host: 10.222.0.32 May 30 12:04:03.789847 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Openstack-System-Scope: None May 30 12:04:03.789847 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: User-Agent: python-urllib3/1.26.9 May 30 12:04:03.789847 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Auth-Token: gAAAAABilLKxmXQ8Hy3DvhiUz3YEb6eyaym-twcAxxEpIb-OU_g6wJdDNIdEefDsj58MRQ8ASL8tNjAhDhgyIoJQdFdLnADVm3mj74pR-2J-r9DVffQlL8-vKbCexZABdDN5JeoNlfKQKO3kc-gMBiOqf6JHIvkKw9poic4Dl8jDaIm_E7DuWo0 May 30 12:04:03.789847 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Domain-Id: None May 30 12:04:03.789847 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Domain-Name: None May 30 12:04:03.789847 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Identity-Status: Confirmed May 30 12:04:03.789847 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Is-Admin-Project: True May 30 12:04:03.789847 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Domain-Id: default May 30 12:04:03.789847 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Domain-Name: Default May 30 12:04:03.789847 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Id: af0e2e127e9941cc8118d8f77f419f64 May 30 12:04:03.789847 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Name: tempest-VolumesNegativeTest-1972169753 May 30 12:04:03.789847 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Role: reader,member May 30 12:04:03.789847 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Roles: reader,member May 30 12:04:03.791151 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/af0e2e127e9941cc8118d8f77f419f64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/af0e2e127e9941cc8118d8f77f419f64"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/af0e2e127e9941cc8118d8f77f419f64"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_af0e2e127e9941cc8118d8f77f419f64", "adminURL": "http://10.222.0.32:8080"}]}] May 30 12:04:03.791151 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Tenant: tempest-VolumesNegativeTest-1972169753 May 30 12:04:03.791151 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Tenant-Id: af0e2e127e9941cc8118d8f77f419f64 May 30 12:04:03.791151 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Tenant-Name: tempest-VolumesNegativeTest-1972169753 May 30 12:04:03.791151 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User: tempest-VolumesNegativeTest-1972169753-project May 30 12:04:03.791151 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Domain-Id: default May 30 12:04:03.791151 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Domain-Name: Default May 30 12:04:03.791151 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Id: 949c0230b6304516a2c22abea205bc43 May 30 12:04:03.791151 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Name: tempest-VolumesNegativeTest-1972169753-project May 30 12:04:03.791151 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: May 30 12:04:03.791151 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-506637278", "metadata": {"Type": "work"}}} May 30 12:04:03.791151 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: method: May 30 12:04:03.791151 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 30 12:04:03.791910 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-506637278', 'metadata': {'Type': 'work'}}}} May 30 12:04:03.791910 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:04:03.791910 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:04:03.791910 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 30 12:04:03.791910 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 30 12:04:03.791910 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 30 12:04:03.791910 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise error May 30 12:04:03.791910 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 30 12:04:03.791910 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:04:03.791910 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 30 12:04:03.791910 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 30 12:04:03.791910 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:04:03.791910 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi On instance['volume']: May 30 12:04:03.791910 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi '' May 30 12:04:03.791910 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:04:03.791910 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:04:03.791910 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:04:03.791910 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:04:03.791910 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:04:03.791910 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:04:03.791910 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:04:03.791910 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:04:03.793206 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 30 12:04:03.793206 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 30 12:04:03.793206 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:04:03.793206 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:04:03.793206 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 30 12:04:03.793206 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 30 12:04:03.793206 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 30 12:04:03.793206 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 30 12:04:03.793206 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 30 12:04:03.793206 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 30 12:04:03.793206 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 30 12:04:03.793206 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:04:03.793206 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:04:03.793206 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:04:03.793206 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:04:03.793206 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:04:03.793206 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:04:03.793206 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 30 12:04:03.793206 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 30 12:04:03.794376 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 30 12:04:03.794376 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:04:03.794376 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-a4397629-5021-46f4-b21f-ada72a9242ca tempest-VolumesNegativeTest-1972169753 tempest-VolumesNegativeTest-1972169753-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:04:03.794582 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-a4397629-5021-46f4-b21f-ada72a9242ca tempest-VolumesNegativeTest-1972169753 tempest-VolumesNegativeTest-1972169753-project] 10.222.0.32 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010474 May 30 12:04:03.798693 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 2/3] 10.222.0.32 () {60 vars in 1155 bytes} [Mon May 30 12:04:03 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 30 12:04:03.807069 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-49e44559-77c9-45b8-b958-5400c95649ba tempest-VolumesNegativeTest-1972169753 tempest-VolumesNegativeTest-1972169753-project] Calling method '.version_select at 0x7f0efa6dc0d0>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:04.602171 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.wsgi [None req-49e44559-77c9-45b8-b958-5400c95649ba tempest-VolumesNegativeTest-1972169753 tempest-VolumesNegativeTest-1972169753-project] HTTP exception thrown: Volume tempest-invalid-553369108 could not be found. May 30 12:04:04.607884 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-49e44559-77c9-45b8-b958-5400c95649ba tempest-VolumesNegativeTest-1972169753 tempest-VolumesNegativeTest-1972169753-project] Request method failure captured: May 30 12:04:04.607884 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-553369108 HTTP/1.1 May 30 12:04:04.607884 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Accept: application/json May 30 12:04:04.607884 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Accept-Encoding: identity May 30 12:04:04.607884 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Connection: close May 30 12:04:04.607884 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Content-Length: 0 May 30 12:04:04.607884 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Content-Type: application/json May 30 12:04:04.607884 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Host: 10.222.0.32 May 30 12:04:04.607884 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Openstack-System-Scope: None May 30 12:04:04.607884 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: User-Agent: python-urllib3/1.26.9 May 30 12:04:04.607884 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Auth-Token: gAAAAABilLKxmXQ8Hy3DvhiUz3YEb6eyaym-twcAxxEpIb-OU_g6wJdDNIdEefDsj58MRQ8ASL8tNjAhDhgyIoJQdFdLnADVm3mj74pR-2J-r9DVffQlL8-vKbCexZABdDN5JeoNlfKQKO3kc-gMBiOqf6JHIvkKw9poic4Dl8jDaIm_E7DuWo0 May 30 12:04:04.607884 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Domain-Id: None May 30 12:04:04.607884 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Domain-Name: None May 30 12:04:04.607884 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Identity-Status: Confirmed May 30 12:04:04.607884 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Is-Admin-Project: True May 30 12:04:04.607884 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Domain-Id: default May 30 12:04:04.607884 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Domain-Name: Default May 30 12:04:04.607884 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Id: af0e2e127e9941cc8118d8f77f419f64 May 30 12:04:04.607884 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Name: tempest-VolumesNegativeTest-1972169753 May 30 12:04:04.607884 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Role: reader,member May 30 12:04:04.607884 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Roles: reader,member May 30 12:04:04.609381 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/af0e2e127e9941cc8118d8f77f419f64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/af0e2e127e9941cc8118d8f77f419f64"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/af0e2e127e9941cc8118d8f77f419f64"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_af0e2e127e9941cc8118d8f77f419f64", "adminURL": "http://10.222.0.32:8080"}]}] May 30 12:04:04.609381 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant: tempest-VolumesNegativeTest-1972169753 May 30 12:04:04.609381 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant-Id: af0e2e127e9941cc8118d8f77f419f64 May 30 12:04:04.609381 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant-Name: tempest-VolumesNegativeTest-1972169753 May 30 12:04:04.609381 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User: tempest-VolumesNegativeTest-1972169753-project May 30 12:04:04.609381 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Domain-Id: default May 30 12:04:04.609381 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Domain-Name: Default May 30 12:04:04.609381 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Id: 949c0230b6304516a2c22abea205bc43 May 30 12:04:04.609381 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Name: tempest-VolumesNegativeTest-1972169753-project May 30 12:04:04.609381 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: method: May 30 12:04:04.609381 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: exception: Volume tempest-invalid-553369108 could not be found. May 30 12:04:04.609381 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: action_args: {'id': 'tempest-invalid-553369108'} May 30 12:04:04.609381 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:04:04.610324 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:04:04.610324 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 30 12:04:04.610324 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 30 12:04:04.610324 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 30 12:04:04.610324 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 30 12:04:04.610324 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 30 12:04:04.610324 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 30 12:04:04.610324 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 30 12:04:04.610324 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 30 12:04:04.610324 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 30 12:04:04.610324 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 30 12:04:04.610324 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 30 12:04:04.610324 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 30 12:04:04.610324 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 30 12:04:04.610324 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 30 12:04:04.610324 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-553369108 could not be found. (HTTP 404) (Request-ID: req-f1c547f6-6e82-4f1a-991f-ddb0224c5cad) May 30 12:04:04.610324 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:04:04.610324 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:04:04.610324 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:04:04.611645 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:04:04.611645 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 30 12:04:04.611645 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 30 12:04:04.611645 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 30 12:04:04.611645 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 30 12:04:04.611645 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 30 12:04:04.611645 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 30 12:04:04.611645 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 30 12:04:04.611645 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 30 12:04:04.611645 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 30 12:04:04.611645 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 30 12:04:04.611645 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 30 12:04:04.611645 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 30 12:04:04.611645 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 30 12:04:04.611645 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 30 12:04:04.611645 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 30 12:04:04.611645 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 30 12:04:04.611645 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 30 12:04:04.611645 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 30 12:04:04.613422 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 30 12:04:04.613422 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 30 12:04:04.613422 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 30 12:04:04.613422 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 30 12:04:04.613422 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-553369108 could not be found. May 30 12:04:04.613422 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:04:04.613422 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:04:04.613422 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:04:04.613422 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:04:04.613422 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:04:04.613422 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:04:04.613422 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:04:04.613422 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:04:04.613422 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 30 12:04:04.613422 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 30 12:04:04.613422 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:04:04.613422 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:04:04.613422 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 30 12:04:04.613422 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:04:04.613422 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-553369108 could not be found. May 30 12:04:04.614818 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:04:04.614818 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:04:04.614818 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:04:04.614818 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:04:04.614818 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:04:04.614818 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:04:04.614818 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:04:04.614818 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:04:04.614818 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-553369108 could not be found. May 30 12:04:04.614818 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:04:04.616999 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-49e44559-77c9-45b8-b958-5400c95649ba tempest-VolumesNegativeTest-1972169753 tempest-VolumesNegativeTest-1972169753-project] Returning 404 to user: Volume tempest-invalid-553369108 could not be found. {{(pid=117670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:04:04.617974 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-49e44559-77c9-45b8-b958-5400c95649ba tempest-VolumesNegativeTest-1972169753 tempest-VolumesNegativeTest-1972169753-project] 10.222.0.32 "DELETE /compute/v2.1/os-volumes/tempest-invalid-553369108" status: 404 len: 98 microversion: 2.1 time: 0.815531 May 30 12:04:04.618543 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 2/4] 10.222.0.32 () {58 vars in 1214 bytes} [Mon May 30 12:04:03 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-553369108 => generated 98 bytes in 817 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 30 12:04:04.630835 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-09001039-19c1-43cf-8d63-58065d5c38a9 tempest-VolumesNegativeTest-1972169753 tempest-VolumesNegativeTest-1972169753-project] 10.222.0.32 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005956 May 30 12:04:04.631394 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 3/5] 10.222.0.32 () {58 vars in 1139 bytes} [Mon May 30 12:04:04 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 30 12:04:04.642534 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-aabf7cbf-f176-42b4-b0d8-57e53e449192 tempest-VolumesNegativeTest-1972169753 tempest-VolumesNegativeTest-1972169753-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005322 May 30 12:04:04.647838 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 3/6] 10.222.0.32 () {58 vars in 1136 bytes} [Mon May 30 12:04:04 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 30 12:04:04.654185 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-5504f1e1-749a-4f32-a843-4a83242678f2 tempest-VolumesNegativeTest-1972169753 tempest-VolumesNegativeTest-1972169753-project] Calling method '.version_select at 0x7f0efa8abc10>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:05.342878 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.wsgi [None req-5504f1e1-749a-4f32-a843-4a83242678f2 tempest-VolumesNegativeTest-1972169753 tempest-VolumesNegativeTest-1972169753-project] HTTP exception thrown: Volume 1a0770e6-3f7f-48c2-b9fc-25528bff3a3a could not be found. May 30 12:04:05.347597 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-5504f1e1-749a-4f32-a843-4a83242678f2 tempest-VolumesNegativeTest-1972169753 tempest-VolumesNegativeTest-1972169753-project] Request method failure captured: May 30 12:04:05.347597 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: request: DELETE /compute/v2.1/os-volumes/1a0770e6-3f7f-48c2-b9fc-25528bff3a3a HTTP/1.1 May 30 12:04:05.347597 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Accept: application/json May 30 12:04:05.347597 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Accept-Encoding: identity May 30 12:04:05.347597 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Connection: close May 30 12:04:05.347597 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Content-Length: 0 May 30 12:04:05.347597 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Content-Type: application/json May 30 12:04:05.347597 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Host: 10.222.0.32 May 30 12:04:05.347597 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Openstack-System-Scope: None May 30 12:04:05.347597 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: User-Agent: python-urllib3/1.26.9 May 30 12:04:05.347597 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Auth-Token: gAAAAABilLKxmXQ8Hy3DvhiUz3YEb6eyaym-twcAxxEpIb-OU_g6wJdDNIdEefDsj58MRQ8ASL8tNjAhDhgyIoJQdFdLnADVm3mj74pR-2J-r9DVffQlL8-vKbCexZABdDN5JeoNlfKQKO3kc-gMBiOqf6JHIvkKw9poic4Dl8jDaIm_E7DuWo0 May 30 12:04:05.347597 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Domain-Id: None May 30 12:04:05.347597 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Domain-Name: None May 30 12:04:05.347597 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Identity-Status: Confirmed May 30 12:04:05.347597 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Is-Admin-Project: True May 30 12:04:05.347597 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Domain-Id: default May 30 12:04:05.347597 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Domain-Name: Default May 30 12:04:05.347597 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Id: af0e2e127e9941cc8118d8f77f419f64 May 30 12:04:05.347597 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Name: tempest-VolumesNegativeTest-1972169753 May 30 12:04:05.347597 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Role: reader,member May 30 12:04:05.347597 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Roles: reader,member May 30 12:04:05.349435 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/af0e2e127e9941cc8118d8f77f419f64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/af0e2e127e9941cc8118d8f77f419f64"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/af0e2e127e9941cc8118d8f77f419f64"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_af0e2e127e9941cc8118d8f77f419f64", "adminURL": "http://10.222.0.32:8080"}]}] May 30 12:04:05.349435 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Tenant: tempest-VolumesNegativeTest-1972169753 May 30 12:04:05.349435 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Tenant-Id: af0e2e127e9941cc8118d8f77f419f64 May 30 12:04:05.349435 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Tenant-Name: tempest-VolumesNegativeTest-1972169753 May 30 12:04:05.349435 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User: tempest-VolumesNegativeTest-1972169753-project May 30 12:04:05.349435 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Domain-Id: default May 30 12:04:05.349435 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Domain-Name: Default May 30 12:04:05.349435 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Id: 949c0230b6304516a2c22abea205bc43 May 30 12:04:05.349435 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Name: tempest-VolumesNegativeTest-1972169753-project May 30 12:04:05.349435 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: method: May 30 12:04:05.349435 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: exception: Volume 1a0770e6-3f7f-48c2-b9fc-25528bff3a3a could not be found. May 30 12:04:05.349435 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: action_args: {'id': '1a0770e6-3f7f-48c2-b9fc-25528bff3a3a'} May 30 12:04:05.349435 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:04:05.350357 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:04:05.350357 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 30 12:04:05.350357 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 30 12:04:05.350357 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 30 12:04:05.350357 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 30 12:04:05.350357 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 30 12:04:05.350357 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 30 12:04:05.350357 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 30 12:04:05.350357 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 30 12:04:05.350357 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 30 12:04:05.350357 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 30 12:04:05.350357 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 30 12:04:05.350357 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 30 12:04:05.350357 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 30 12:04:05.350357 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 30 12:04:05.350357 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1a0770e6-3f7f-48c2-b9fc-25528bff3a3a could not be found. (HTTP 404) (Request-ID: req-6a5215ab-a3a8-4d3f-9c02-0346f746c52a) May 30 12:04:05.350357 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:04:05.350357 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:04:05.350357 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:04:05.351671 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:04:05.351671 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 30 12:04:05.351671 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 30 12:04:05.351671 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 30 12:04:05.351671 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 30 12:04:05.351671 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 30 12:04:05.351671 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 30 12:04:05.351671 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 30 12:04:05.351671 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 30 12:04:05.351671 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 30 12:04:05.351671 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 30 12:04:05.351671 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 30 12:04:05.351671 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 30 12:04:05.351671 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 30 12:04:05.351671 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 30 12:04:05.351671 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 30 12:04:05.351671 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 30 12:04:05.351671 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 30 12:04:05.351671 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 30 12:04:05.352992 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 30 12:04:05.352992 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 30 12:04:05.352992 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 30 12:04:05.352992 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 30 12:04:05.352992 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1a0770e6-3f7f-48c2-b9fc-25528bff3a3a could not be found. May 30 12:04:05.352992 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:04:05.352992 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:04:05.352992 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:04:05.352992 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:04:05.352992 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:04:05.352992 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:04:05.352992 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:04:05.352992 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:04:05.352992 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 30 12:04:05.352992 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 30 12:04:05.352992 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:04:05.352992 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:04:05.352992 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 30 12:04:05.352992 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:04:05.354276 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1a0770e6-3f7f-48c2-b9fc-25528bff3a3a could not be found. May 30 12:04:05.354276 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:04:05.354276 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:04:05.354276 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:04:05.354276 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:04:05.354276 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:04:05.354276 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:04:05.354276 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:04:05.354276 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:04:05.354276 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1a0770e6-3f7f-48c2-b9fc-25528bff3a3a could not be found. May 30 12:04:05.354276 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:04:05.355976 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-5504f1e1-749a-4f32-a843-4a83242678f2 tempest-VolumesNegativeTest-1972169753 tempest-VolumesNegativeTest-1972169753-project] Returning 404 to user: Volume 1a0770e6-3f7f-48c2-b9fc-25528bff3a3a could not be found. {{(pid=117671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:04:05.357093 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-5504f1e1-749a-4f32-a843-4a83242678f2 tempest-VolumesNegativeTest-1972169753 tempest-VolumesNegativeTest-1972169753-project] 10.222.0.32 "DELETE /compute/v2.1/os-volumes/1a0770e6-3f7f-48c2-b9fc-25528bff3a3a" status: 404 len: 109 microversion: 2.1 time: 0.707994 May 30 12:04:05.359079 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 4/7] 10.222.0.32 () {58 vars in 1247 bytes} [Mon May 30 12:04:04 2022] DELETE /compute/v2.1/os-volumes/1a0770e6-3f7f-48c2-b9fc-25528bff3a3a => generated 109 bytes in 711 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 30 12:04:05.369131 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-451ac357-5c41-4284-bed2-221c9e037ff7 tempest-VolumesNegativeTest-1972169753 tempest-VolumesNegativeTest-1972169753-project] Calling method '.version_select at 0x7f0efa63a040>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:05.412133 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.wsgi [None req-451ac357-5c41-4284-bed2-221c9e037ff7 tempest-VolumesNegativeTest-1972169753 tempest-VolumesNegativeTest-1972169753-project] HTTP exception thrown: Volume 1bd7827c-e51c-40a5-b9d8-1d9f55ce514a could not be found. May 30 12:04:05.414909 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-451ac357-5c41-4284-bed2-221c9e037ff7 tempest-VolumesNegativeTest-1972169753 tempest-VolumesNegativeTest-1972169753-project] Request method failure captured: May 30 12:04:05.414909 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: request: GET /compute/v2.1/os-volumes/1bd7827c-e51c-40a5-b9d8-1d9f55ce514a HTTP/1.1 May 30 12:04:05.414909 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Accept: application/json May 30 12:04:05.414909 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Accept-Encoding: identity May 30 12:04:05.414909 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Connection: close May 30 12:04:05.414909 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Content-Length: 0 May 30 12:04:05.414909 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Content-Type: application/json May 30 12:04:05.414909 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Host: 10.222.0.32 May 30 12:04:05.414909 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Openstack-System-Scope: None May 30 12:04:05.414909 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: User-Agent: python-urllib3/1.26.9 May 30 12:04:05.414909 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Auth-Token: gAAAAABilLKxmXQ8Hy3DvhiUz3YEb6eyaym-twcAxxEpIb-OU_g6wJdDNIdEefDsj58MRQ8ASL8tNjAhDhgyIoJQdFdLnADVm3mj74pR-2J-r9DVffQlL8-vKbCexZABdDN5JeoNlfKQKO3kc-gMBiOqf6JHIvkKw9poic4Dl8jDaIm_E7DuWo0 May 30 12:04:05.414909 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Domain-Id: None May 30 12:04:05.414909 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Domain-Name: None May 30 12:04:05.414909 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Identity-Status: Confirmed May 30 12:04:05.414909 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Is-Admin-Project: True May 30 12:04:05.414909 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Domain-Id: default May 30 12:04:05.414909 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Domain-Name: Default May 30 12:04:05.414909 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Id: af0e2e127e9941cc8118d8f77f419f64 May 30 12:04:05.414909 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Name: tempest-VolumesNegativeTest-1972169753 May 30 12:04:05.414909 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Role: reader,member May 30 12:04:05.414909 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Roles: reader,member May 30 12:04:05.416601 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/af0e2e127e9941cc8118d8f77f419f64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/af0e2e127e9941cc8118d8f77f419f64"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/af0e2e127e9941cc8118d8f77f419f64"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_af0e2e127e9941cc8118d8f77f419f64", "adminURL": "http://10.222.0.32:8080"}]}] May 30 12:04:05.416601 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant: tempest-VolumesNegativeTest-1972169753 May 30 12:04:05.416601 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant-Id: af0e2e127e9941cc8118d8f77f419f64 May 30 12:04:05.416601 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant-Name: tempest-VolumesNegativeTest-1972169753 May 30 12:04:05.416601 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User: tempest-VolumesNegativeTest-1972169753-project May 30 12:04:05.416601 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Domain-Id: default May 30 12:04:05.416601 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Domain-Name: Default May 30 12:04:05.416601 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Id: 949c0230b6304516a2c22abea205bc43 May 30 12:04:05.416601 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Name: tempest-VolumesNegativeTest-1972169753-project May 30 12:04:05.416601 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: method: May 30 12:04:05.416601 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: exception: Volume 1bd7827c-e51c-40a5-b9d8-1d9f55ce514a could not be found. May 30 12:04:05.416601 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: action_args: {'id': '1bd7827c-e51c-40a5-b9d8-1d9f55ce514a'} May 30 12:04:05.416601 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:04:05.417567 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:04:05.417567 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 30 12:04:05.417567 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 30 12:04:05.417567 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 30 12:04:05.417567 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi item = cinderclient( May 30 12:04:05.417567 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 30 12:04:05.417567 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 30 12:04:05.417567 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 30 12:04:05.417567 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 30 12:04:05.417567 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 30 12:04:05.417567 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 30 12:04:05.417567 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 30 12:04:05.417567 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 30 12:04:05.417567 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 30 12:04:05.417567 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 30 12:04:05.417567 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1bd7827c-e51c-40a5-b9d8-1d9f55ce514a could not be found. (HTTP 404) (Request-ID: req-49eadbd8-b222-48e7-a086-640024338589) May 30 12:04:05.417567 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:04:05.417567 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:04:05.417567 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:04:05.418879 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:04:05.418879 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 30 12:04:05.418879 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 30 12:04:05.418879 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 30 12:04:05.418879 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 30 12:04:05.418879 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 30 12:04:05.418879 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 30 12:04:05.418879 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 30 12:04:05.418879 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 30 12:04:05.418879 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 30 12:04:05.418879 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 30 12:04:05.418879 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 30 12:04:05.418879 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi item = cinderclient( May 30 12:04:05.418879 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 30 12:04:05.418879 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 30 12:04:05.418879 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 30 12:04:05.418879 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 30 12:04:05.418879 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 30 12:04:05.418879 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 30 12:04:05.420378 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 30 12:04:05.420378 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 30 12:04:05.420378 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 30 12:04:05.420378 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 30 12:04:05.420378 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1bd7827c-e51c-40a5-b9d8-1d9f55ce514a could not be found. May 30 12:04:05.420378 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:04:05.420378 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:04:05.420378 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:04:05.420378 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:04:05.420378 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:04:05.420378 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:04:05.420378 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:04:05.420378 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:04:05.420378 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 30 12:04:05.420378 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 30 12:04:05.420378 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:04:05.420378 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:04:05.420378 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 30 12:04:05.420378 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:04:05.421744 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1bd7827c-e51c-40a5-b9d8-1d9f55ce514a could not be found. May 30 12:04:05.421744 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:04:05.421744 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:04:05.421744 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:04:05.421744 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:04:05.421744 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:04:05.421744 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:04:05.421744 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:04:05.421744 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:04:05.421744 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1bd7827c-e51c-40a5-b9d8-1d9f55ce514a could not be found. May 30 12:04:05.421744 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:04:05.423377 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-451ac357-5c41-4284-bed2-221c9e037ff7 tempest-VolumesNegativeTest-1972169753 tempest-VolumesNegativeTest-1972169753-project] Returning 404 to user: Volume 1bd7827c-e51c-40a5-b9d8-1d9f55ce514a could not be found. {{(pid=117670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:04:05.424417 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-451ac357-5c41-4284-bed2-221c9e037ff7 tempest-VolumesNegativeTest-1972169753 tempest-VolumesNegativeTest-1972169753-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/1bd7827c-e51c-40a5-b9d8-1d9f55ce514a" status: 404 len: 109 microversion: 2.1 time: 0.059134 May 30 12:04:05.426189 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 4/8] 10.222.0.32 () {58 vars in 1244 bytes} [Mon May 30 12:04:05 2022] GET /compute/v2.1/os-volumes/1bd7827c-e51c-40a5-b9d8-1d9f55ce514a => generated 109 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 30 12:04:08.028976 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-9e9fd3a2-ba68-4949-a5ec-78d7887678a2 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-507513528", "imageRef": "b8ef93ed-af98-4d8c-9e1d-43d7b1f2b832", "flavorRef": "452", "networks": [{"uuid": "058f1ca1-dd47-4544-bac8-2587bcf6b3a9"}]}} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:04:08.334667 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.network.neutron [None req-9e9fd3a2-ba68-4949-a5ec-78d7887678a2 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] validate_networks() for [('058f1ca1-dd47-4544-bac8-2587bcf6b3a9', None, None, None, None, None)] {{(pid=117671) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 30 12:04:09.609307 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-385e6277-a0ce-45fa-b1bc-4871f486e7bd tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Action: 'create', calling method: .version_select at 0x7f0efa612b80>, body: {"keypair": {"name": "tempest-keypair-2098804648", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOHTIQtqMElzsyAnEUkFiBWO+f4zVUAIoCT5Wv3BvW64sduCVNHDGWL4VYbBNuGF+PqP6RBQkSEmdhjIeUA68YR5OUt24oiL/NXWZr+9b18BFrRTYseDiXUFlqyLagYa8g=="}} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:04:09.712226 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.quota [None req-385e6277-a0ce-45fa-b1bc-4871f486e7bd tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Getting quotas for project 8b5074cf3e6248668995f266845c8969. Resources: {'key_pairs'} {{(pid=117670) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 30 12:04:09.731104 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.quota [None req-385e6277-a0ce-45fa-b1bc-4871f486e7bd tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Getting quotas for user c76e8d7bfdc04ea79c83ca7fb6b9ade1 and project 8b5074cf3e6248668995f266845c8969. Resources: {'key_pairs'} {{(pid=117670) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 30 12:04:09.841456 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-385e6277-a0ce-45fa-b1bc-4871f486e7bd tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.761653 May 30 12:04:09.842141 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 5/9] 10.222.0.32 () {60 vars in 1158 bytes} [Mon May 30 12:04:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 30 12:04:11.276594 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-9e9fd3a2-ba68-4949-a5ec-78d7887678a2 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Flavor limits 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 30 12:04:11.277749 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-9e9fd3a2-ba68-4949-a5ec-78d7887678a2 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Image limits 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 30 12:04:11.278347 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-9e9fd3a2-ba68-4949-a5ec-78d7887678a2 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Flavor pref 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 30 12:04:11.278857 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-9e9fd3a2-ba68-4949-a5ec-78d7887678a2 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Image pref 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 30 12:04:11.279556 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-9e9fd3a2-ba68-4949-a5ec-78d7887678a2 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 30 12:04:11.318331 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9e9fd3a2-ba68-4949-a5ec-78d7887678a2 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:11.318967 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9e9fd3a2-ba68-4949-a5ec-78d7887678a2 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:11.321727 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9e9fd3a2-ba68-4949-a5ec-78d7887678a2 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:11.323229 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9e9fd3a2-ba68-4949-a5ec-78d7887678a2 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:11.439758 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.quota [None req-9e9fd3a2-ba68-4949-a5ec-78d7887678a2 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Getting quotas for project a60b241805384ef49352b3791cfd3d8c. Resources: {'cores', 'instances', 'ram'} {{(pid=117671) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 30 12:04:11.459596 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.quota [None req-9e9fd3a2-ba68-4949-a5ec-78d7887678a2 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Getting quotas for user e591526a8c3645de9c5965a40f8ef90a and project a60b241805384ef49352b3791cfd3d8c. Resources: {'cores', 'instances', 'ram'} {{(pid=117671) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 30 12:04:11.486671 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-9e9fd3a2-ba68-4949-a5ec-78d7887678a2 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Going to run 1 instances... {{(pid=117671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 30 12:04:11.492207 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-9e9fd3a2-ba68-4949-a5ec-78d7887678a2 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] [instance: 5a06904b-d932-4635-90df-b69dcb15d941] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b8ef93ed-af98-4d8c-9e1d-43d7b1f2b832',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 30 12:04:11.664226 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-9e9fd3a2-ba68-4949-a5ec-78d7887678a2 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.292239 May 30 12:04:11.670812 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 5/10] 10.222.0.32 () {60 vars in 1146 bytes} [Mon May 30 12:04:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 4300 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 30 12:04:11.677964 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-fa0a6956-c7eb-42dd-9886-357058f583e6 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:11.679313 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-fa0a6956-c7eb-42dd-9886-357058f583e6 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] [instance: 5a06904b-d932-4635-90df-b69dcb15d941] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:11.992707 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-fa0a6956-c7eb-42dd-9886-357058f583e6 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e591526a8c3645de9c5965a40f8ef90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60b241805384ef49352b3791cfd3d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:12.027582 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-fa0a6956-c7eb-42dd-9886-357058f583e6 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] 10.222.0.32 "GET /compute/v2.1/servers/5a06904b-d932-4635-90df-b69dcb15d941" status: 200 len: 1214 microversion: 2.1 time: 0.355445 May 30 12:04:12.028538 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 6/11] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:04:11 2022] GET /compute/v2.1/servers/5a06904b-d932-4635-90df-b69dcb15d941 => generated 1214 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:04:13.047432 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-36862b92-8432-4b5d-a029-8c637f9c878e tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:13.048346 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-36862b92-8432-4b5d-a029-8c637f9c878e tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] [instance: 5a06904b-d932-4635-90df-b69dcb15d941] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:13.336215 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-36862b92-8432-4b5d-a029-8c637f9c878e tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e591526a8c3645de9c5965a40f8ef90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60b241805384ef49352b3791cfd3d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:13.370879 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-36862b92-8432-4b5d-a029-8c637f9c878e tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] 10.222.0.32 "GET /compute/v2.1/servers/5a06904b-d932-4635-90df-b69dcb15d941" status: 200 len: 1214 microversion: 2.1 time: 0.327421 May 30 12:04:13.371967 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 6/12] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:04:13 2022] GET /compute/v2.1/servers/5a06904b-d932-4635-90df-b69dcb15d941 => generated 1214 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:04:14.389286 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-53d8941d-3a29-465d-8f3d-e07d3e6f214d tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:14.390633 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-53d8941d-3a29-465d-8f3d-e07d3e6f214d tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] [instance: 5a06904b-d932-4635-90df-b69dcb15d941] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:14.405773 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-53d8941d-3a29-465d-8f3d-e07d3e6f214d tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:14.408492 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-53d8941d-3a29-465d-8f3d-e07d3e6f214d tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:14.411382 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-53d8941d-3a29-465d-8f3d-e07d3e6f214d tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:14.411985 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-53d8941d-3a29-465d-8f3d-e07d3e6f214d tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:14.893739 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-53d8941d-3a29-465d-8f3d-e07d3e6f214d tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e591526a8c3645de9c5965a40f8ef90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60b241805384ef49352b3791cfd3d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:14.921722 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-53d8941d-3a29-465d-8f3d-e07d3e6f214d tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] 10.222.0.32 "GET /compute/v2.1/servers/5a06904b-d932-4635-90df-b69dcb15d941" status: 200 len: 1218 microversion: 2.1 time: 0.537354 May 30 12:04:14.933525 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 7/13] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:04:14 2022] GET /compute/v2.1/servers/5a06904b-d932-4635-90df-b69dcb15d941 => generated 1218 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:04:15.943091 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-60c0ad07-c5c8-4763-bdb6-b3c34b3dd0d3 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:15.943839 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-60c0ad07-c5c8-4763-bdb6-b3c34b3dd0d3 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] [instance: 5a06904b-d932-4635-90df-b69dcb15d941] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:15.958316 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-60c0ad07-c5c8-4763-bdb6-b3c34b3dd0d3 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:15.961145 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-60c0ad07-c5c8-4763-bdb6-b3c34b3dd0d3 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:15.962171 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-60c0ad07-c5c8-4763-bdb6-b3c34b3dd0d3 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:15.962796 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-60c0ad07-c5c8-4763-bdb6-b3c34b3dd0d3 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:16.739836 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-60c0ad07-c5c8-4763-bdb6-b3c34b3dd0d3 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e591526a8c3645de9c5965a40f8ef90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60b241805384ef49352b3791cfd3d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:16.759093 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-60c0ad07-c5c8-4763-bdb6-b3c34b3dd0d3 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] 10.222.0.32 "GET /compute/v2.1/servers/5a06904b-d932-4635-90df-b69dcb15d941" status: 200 len: 1210 microversion: 2.1 time: 0.820634 May 30 12:04:16.770622 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 7/14] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:04:15 2022] GET /compute/v2.1/servers/5a06904b-d932-4635-90df-b69dcb15d941 => generated 1210 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:04:17.314364 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-999e3624-7dc1-4567-9c6b-19a65c37612c tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Action: 'create', calling method: .version_select at 0x7f0ef9c8f0d0>, body: {"keypair": {"name": "tempest-keypair-1295167922", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHB+FoQxEdPDCc0MVz/Db1hxOh07cOtWPkur3IeT3I1Nh2hgL4BHHAdQDcZbsdedAliExh/VUjsVZKFJ3sugQdxYjEsd1gjDHSmO4tDMoTomzTOdfDqGJ4pFsBoo3wUrOg=="}} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:04:17.358490 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.quota [None req-999e3624-7dc1-4567-9c6b-19a65c37612c tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Getting quotas for project 20763921c37c4e81bba702e09bf628b2. Resources: {'key_pairs'} {{(pid=117670) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 30 12:04:17.375980 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.quota [None req-999e3624-7dc1-4567-9c6b-19a65c37612c tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Getting quotas for user 7575179edbda45208561c983fc5b956c and project 20763921c37c4e81bba702e09bf628b2. Resources: {'key_pairs'} {{(pid=117670) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 30 12:04:17.432050 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-999e3624-7dc1-4567-9c6b-19a65c37612c tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.424937 May 30 12:04:17.432670 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 8/15] 10.222.0.32 () {60 vars in 1158 bytes} [Mon May 30 12:04:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 30 12:04:17.777784 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-795ad141-345f-43e4-b72d-0ab1a11a8a74 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:17.778731 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-795ad141-345f-43e4-b72d-0ab1a11a8a74 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] [instance: 5a06904b-d932-4635-90df-b69dcb15d941] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:17.786306 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-795ad141-345f-43e4-b72d-0ab1a11a8a74 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:17.794074 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-795ad141-345f-43e4-b72d-0ab1a11a8a74 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:17.795281 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-795ad141-345f-43e4-b72d-0ab1a11a8a74 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:17.795963 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-795ad141-345f-43e4-b72d-0ab1a11a8a74 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:18.074623 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-795ad141-345f-43e4-b72d-0ab1a11a8a74 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e591526a8c3645de9c5965a40f8ef90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60b241805384ef49352b3791cfd3d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:18.091815 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-795ad141-345f-43e4-b72d-0ab1a11a8a74 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] 10.222.0.32 "GET /compute/v2.1/servers/5a06904b-d932-4635-90df-b69dcb15d941" status: 200 len: 1266 microversion: 2.1 time: 0.312631 May 30 12:04:18.093935 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 8/16] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:04:17 2022] GET /compute/v2.1/servers/5a06904b-d932-4635-90df-b69dcb15d941 => generated 1266 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:04:18.320005 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-a74e7380-4979-48b3-b90f-4a251208f9b7 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-660636925", "imageRef": "b8ef93ed-af98-4d8c-9e1d-43d7b1f2b832", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e532e692-bceb-4466-adae-3cc4239d2d96"}], "security_groups": [{"name": "tempest-securitygroup--817352089"}], "key_name": "tempest-keypair-2098804648", "user_data": "}} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:04:19.004276 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.network.neutron [None req-a74e7380-4979-48b3-b90f-4a251208f9b7 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] validate_networks() for [('e532e692-bceb-4466-adae-3cc4239d2d96', None, None, None, None, None)] {{(pid=117670) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 30 12:04:19.112901 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-2a4a3d89-b9ce-437e-85ad-32d2f12fcf02 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:19.115394 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-2a4a3d89-b9ce-437e-85ad-32d2f12fcf02 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] [instance: 5a06904b-d932-4635-90df-b69dcb15d941] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:19.136257 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2a4a3d89-b9ce-437e-85ad-32d2f12fcf02 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:19.139103 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2a4a3d89-b9ce-437e-85ad-32d2f12fcf02 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:19.139971 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2a4a3d89-b9ce-437e-85ad-32d2f12fcf02 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:19.143021 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2a4a3d89-b9ce-437e-85ad-32d2f12fcf02 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:19.451410 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-2a4a3d89-b9ce-437e-85ad-32d2f12fcf02 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e591526a8c3645de9c5965a40f8ef90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60b241805384ef49352b3791cfd3d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:19.460912 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-2a4a3d89-b9ce-437e-85ad-32d2f12fcf02 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] 10.222.0.32 "GET /compute/v2.1/servers/5a06904b-d932-4635-90df-b69dcb15d941" status: 200 len: 1272 microversion: 2.1 time: 0.354307 May 30 12:04:19.471779 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 9/17] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:04:19 2022] GET /compute/v2.1/servers/5a06904b-d932-4635-90df-b69dcb15d941 => generated 1272 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:04:20.478988 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-f5caf829-f7d0-4413-a849-e2263cbc1968 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:20.479805 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-f5caf829-f7d0-4413-a849-e2263cbc1968 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] [instance: 5a06904b-d932-4635-90df-b69dcb15d941] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:20.487775 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f5caf829-f7d0-4413-a849-e2263cbc1968 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:20.500817 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f5caf829-f7d0-4413-a849-e2263cbc1968 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:20.501709 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f5caf829-f7d0-4413-a849-e2263cbc1968 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:20.502760 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f5caf829-f7d0-4413-a849-e2263cbc1968 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:21.085118 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-f5caf829-f7d0-4413-a849-e2263cbc1968 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e591526a8c3645de9c5965a40f8ef90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60b241805384ef49352b3791cfd3d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:21.095227 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-f5caf829-f7d0-4413-a849-e2263cbc1968 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] 10.222.0.32 "GET /compute/v2.1/servers/5a06904b-d932-4635-90df-b69dcb15d941" status: 200 len: 1272 microversion: 2.1 time: 0.620181 May 30 12:04:21.109980 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 10/18] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:04:20 2022] GET /compute/v2.1/servers/5a06904b-d932-4635-90df-b69dcb15d941 => generated 1272 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:04:22.127681 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-3cbeade8-f401-41a1-a106-2406b2331a3e tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:22.128682 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-3cbeade8-f401-41a1-a106-2406b2331a3e tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] [instance: 5a06904b-d932-4635-90df-b69dcb15d941] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:22.130540 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell0:SELECT=2 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:04:22.141560 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3cbeade8-f401-41a1-a106-2406b2331a3e tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:22.148557 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3cbeade8-f401-41a1-a106-2406b2331a3e tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:22.149979 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3cbeade8-f401-41a1-a106-2406b2331a3e tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:22.150614 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3cbeade8-f401-41a1-a106-2406b2331a3e tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:22.921920 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-3cbeade8-f401-41a1-a106-2406b2331a3e tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e591526a8c3645de9c5965a40f8ef90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60b241805384ef49352b3791cfd3d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:22.973377 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-3cbeade8-f401-41a1-a106-2406b2331a3e tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] 10.222.0.32 "GET /compute/v2.1/servers/5a06904b-d932-4635-90df-b69dcb15d941" status: 200 len: 1314 microversion: 2.1 time: 0.828011 May 30 12:04:22.975041 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 11/19] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:04:22 2022] GET /compute/v2.1/servers/5a06904b-d932-4635-90df-b69dcb15d941 => generated 1314 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:04:23.017259 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-a74e7380-4979-48b3-b90f-4a251208f9b7 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Flavor limits 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 30 12:04:23.034769 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-a74e7380-4979-48b3-b90f-4a251208f9b7 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Image limits 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 30 12:04:23.035333 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-a74e7380-4979-48b3-b90f-4a251208f9b7 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Flavor pref 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 30 12:04:23.035792 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-a74e7380-4979-48b3-b90f-4a251208f9b7 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Image pref 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 30 12:04:23.038856 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-a74e7380-4979-48b3-b90f-4a251208f9b7 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 30 12:04:23.087416 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a74e7380-4979-48b3-b90f-4a251208f9b7 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:23.088936 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a74e7380-4979-48b3-b90f-4a251208f9b7 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:23.093238 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a74e7380-4979-48b3-b90f-4a251208f9b7 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:23.096401 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a74e7380-4979-48b3-b90f-4a251208f9b7 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:23.202494 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.quota [None req-a74e7380-4979-48b3-b90f-4a251208f9b7 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Getting quotas for project 8b5074cf3e6248668995f266845c8969. Resources: {'cores', 'instances', 'ram'} {{(pid=117670) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 30 12:04:23.219199 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.quota [None req-a74e7380-4979-48b3-b90f-4a251208f9b7 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Getting quotas for user c76e8d7bfdc04ea79c83ca7fb6b9ade1 and project 8b5074cf3e6248668995f266845c8969. Resources: {'cores', 'instances', 'ram'} {{(pid=117670) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 30 12:04:23.302320 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-a74e7380-4979-48b3-b90f-4a251208f9b7 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Going to run 1 instances... {{(pid=117670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 30 12:04:23.315636 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-a74e7380-4979-48b3-b90f-4a251208f9b7 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 08b1b860-516e-4041-8df8-1fa8cc65a4ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b8ef93ed-af98-4d8c-9e1d-43d7b1f2b832',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 30 12:04:23.630514 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-a74e7380-4979-48b3-b90f-4a251208f9b7 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 5.317595 May 30 12:04:23.631982 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 9/20] 10.222.0.32 () {60 vars in 1146 bytes} [Mon May 30 12:04:18 2022] POST /compute/v2.1/servers => generated 401 bytes in 5320 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 30 12:04:23.643279 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-8fe1d190-067d-4754-b1ca-192a1e90b78e tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:23.645184 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-8fe1d190-067d-4754-b1ca-192a1e90b78e tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 08b1b860-516e-4041-8df8-1fa8cc65a4ed] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:23.657484 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell0:SELECT=8 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:04:23.991928 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-8fe1d190-067d-4754-b1ca-192a1e90b78e tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76e8d7bfdc04ea79c83ca7fb6b9ade1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5074cf3e6248668995f266845c8969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:23.995439 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-6b69af3e-3f8b-4dfe-8994-d8383fc17d21 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:23.996326 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-6b69af3e-3f8b-4dfe-8994-d8383fc17d21 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] [instance: 5a06904b-d932-4635-90df-b69dcb15d941] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:24.003267 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-8fe1d190-067d-4754-b1ca-192a1e90b78e tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed" status: 200 len: 1237 microversion: 2.1 time: 0.362107 May 30 12:04:24.005094 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 12/21] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:04:23 2022] GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed => generated 1237 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:04:24.019653 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6b69af3e-3f8b-4dfe-8994-d8383fc17d21 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:24.029838 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6b69af3e-3f8b-4dfe-8994-d8383fc17d21 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:24.036582 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6b69af3e-3f8b-4dfe-8994-d8383fc17d21 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:24.040318 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6b69af3e-3f8b-4dfe-8994-d8383fc17d21 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:25.324182 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-489277ec-a1ab-4dd8-9649-32b0787300be tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Action: 'create', calling method: .version_select at 0x7f0ef93de160>, body: {"keypair": {"name": "tempest-keypair-2112876361", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNuf3qlAlRzUNvvWk938d9/3mxU2xe6IlcaSbb8zmE8/nCmkfsFfk/z93e5trNrsIsvB+7DlGBP1+y1QLp0SacEROoTl3cR1/jqiMWdBo/jP4ziaDfcZ0Wk0Ft/bpM2/Sg=="}} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:04:25.377637 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.quota [None req-489277ec-a1ab-4dd8-9649-32b0787300be tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Getting quotas for project 8e98cc41e8064c90b0e45b32e2d78493. Resources: {'key_pairs'} {{(pid=117671) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 30 12:04:25.388187 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.quota [None req-489277ec-a1ab-4dd8-9649-32b0787300be tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Getting quotas for user bc47c5bf77894aefa6ecde115ed9f88f and project 8e98cc41e8064c90b0e45b32e2d78493. Resources: {'key_pairs'} {{(pid=117671) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 30 12:04:25.525386 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-489277ec-a1ab-4dd8-9649-32b0787300be tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.726818 May 30 12:04:25.542493 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 13/22] 10.222.0.32 () {62 vars in 1199 bytes} [Mon May 30 12:04:24 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 744 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) May 30 12:04:25.565796 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-a6be46f8-b1dd-42ab-8aab-97a1fb32e0a7 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:25.566812 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-6b69af3e-3f8b-4dfe-8994-d8383fc17d21 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e591526a8c3645de9c5965a40f8ef90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60b241805384ef49352b3791cfd3d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:25.568028 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-a6be46f8-b1dd-42ab-8aab-97a1fb32e0a7 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 08b1b860-516e-4041-8df8-1fa8cc65a4ed] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:25.591712 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-6b69af3e-3f8b-4dfe-8994-d8383fc17d21 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] 10.222.0.32 "GET /compute/v2.1/servers/5a06904b-d932-4635-90df-b69dcb15d941" status: 200 len: 1314 microversion: 2.1 time: 1.600148 May 30 12:04:25.599284 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 10/23] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:04:23 2022] GET /compute/v2.1/servers/5a06904b-d932-4635-90df-b69dcb15d941 => generated 1314 bytes in 1609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:04:25.941910 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-b73f81d5-0b0c-44bb-836c-e608b79f5718 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-848866166", "imageRef": "b8ef93ed-af98-4d8c-9e1d-43d7b1f2b832", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "910909fe-c0b0-4c8d-8e4c-a23ea4b0eddd"}], "security_groups": [{"name": "tempest-securitygroup--2008437464"}], "key_name": "tempest-keypair-1295167922", "user_data": "}} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:04:26.288989 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-a6be46f8-b1dd-42ab-8aab-97a1fb32e0a7 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76e8d7bfdc04ea79c83ca7fb6b9ade1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5074cf3e6248668995f266845c8969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:26.309449 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-a6be46f8-b1dd-42ab-8aab-97a1fb32e0a7 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed" status: 200 len: 1237 microversion: 2.1 time: 0.765382 May 30 12:04:26.329758 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 14/24] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:04:25 2022] GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed => generated 1237 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:04:26.616696 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-616896f4-14ff-4290-9501-8d00cf0780df tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:26.627393 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-616896f4-14ff-4290-9501-8d00cf0780df tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] [instance: 5a06904b-d932-4635-90df-b69dcb15d941] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:26.645721 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-616896f4-14ff-4290-9501-8d00cf0780df tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:26.659587 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-616896f4-14ff-4290-9501-8d00cf0780df tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:26.662335 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-616896f4-14ff-4290-9501-8d00cf0780df tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:26.664255 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-616896f4-14ff-4290-9501-8d00cf0780df tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:27.119713 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-616896f4-14ff-4290-9501-8d00cf0780df tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e591526a8c3645de9c5965a40f8ef90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60b241805384ef49352b3791cfd3d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:27.133605 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-616896f4-14ff-4290-9501-8d00cf0780df tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] 10.222.0.32 "GET /compute/v2.1/servers/5a06904b-d932-4635-90df-b69dcb15d941" status: 200 len: 1314 microversion: 2.1 time: 0.520883 May 30 12:04:27.136275 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 15/25] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:04:26 2022] GET /compute/v2.1/servers/5a06904b-d932-4635-90df-b69dcb15d941 => generated 1314 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:04:27.501545 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-c94031b1-9bd0-4b63-8054-570408d881d6 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2071617331", "imageRef": "b8ef93ed-af98-4d8c-9e1d-43d7b1f2b832", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:04:33.169577 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell0:SELECT=2 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:04:33.277064 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell0:SELECT=16 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:04:35.062769 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.network.neutron [None req-c94031b1-9bd0-4b63-8054-570408d881d6 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] validate_networks() for [('1df1af59-dc4a-4ec6-926a-e35a4841adfa', None, None, None, None, None)] {{(pid=117671) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 30 12:04:35.178506 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.network.neutron [None req-b73f81d5-0b0c-44bb-836c-e608b79f5718 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] validate_networks() for [('910909fe-c0b0-4c8d-8e4c-a23ea4b0eddd', None, None, None, None, None)] {{(pid=117670) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 30 12:04:35.526837 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=5 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:04:35.575381 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell1:SELECT=14 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:04:35.734642 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-c94031b1-9bd0-4b63-8054-570408d881d6 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Flavor limits 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 30 12:04:35.735074 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-c94031b1-9bd0-4b63-8054-570408d881d6 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Image limits 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 30 12:04:35.735553 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-c94031b1-9bd0-4b63-8054-570408d881d6 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Flavor pref 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 30 12:04:35.736010 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-c94031b1-9bd0-4b63-8054-570408d881d6 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Image pref 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 30 12:04:35.736814 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-c94031b1-9bd0-4b63-8054-570408d881d6 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 30 12:04:35.738873 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=4 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:04:35.748785 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c94031b1-9bd0-4b63-8054-570408d881d6 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:35.749240 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c94031b1-9bd0-4b63-8054-570408d881d6 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:35.752421 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c94031b1-9bd0-4b63-8054-570408d881d6 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:35.752973 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c94031b1-9bd0-4b63-8054-570408d881d6 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:35.763870 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell1:SELECT=39 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:04:35.781436 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.quota [None req-c94031b1-9bd0-4b63-8054-570408d881d6 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Getting quotas for project c988db8e79bf4c98ac288105177f90f2. Resources: {'cores', 'instances', 'ram'} {{(pid=117671) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 30 12:04:35.787327 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.quota [None req-c94031b1-9bd0-4b63-8054-570408d881d6 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Getting quotas for user 166b42a5d6c04659afb20c088dfead76 and project c988db8e79bf4c98ac288105177f90f2. Resources: {'cores', 'instances', 'ram'} {{(pid=117671) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 30 12:04:35.803491 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-c94031b1-9bd0-4b63-8054-570408d881d6 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Going to run 1 instances... {{(pid=117671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 30 12:04:35.805993 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-c94031b1-9bd0-4b63-8054-570408d881d6 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: dcdae5e3-81e8-412d-9e2a-0a481c13b57b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b8ef93ed-af98-4d8c-9e1d-43d7b1f2b832',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 30 12:04:35.857357 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-b73f81d5-0b0c-44bb-836c-e608b79f5718 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Flavor limits 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 30 12:04:35.857966 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-b73f81d5-0b0c-44bb-836c-e608b79f5718 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Image limits 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 30 12:04:35.860503 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-c94031b1-9bd0-4b63-8054-570408d881d6 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 8.722529 May 30 12:04:35.861514 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 16/26] 10.222.0.32 () {60 vars in 1146 bytes} [Mon May 30 12:04:27 2022] POST /compute/v2.1/servers => generated 383 bytes in 8724 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 30 12:04:35.866652 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-5cb7701e-ed01-4036-801c-dd0e81e9f184 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:35.867276 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-5cb7701e-ed01-4036-801c-dd0e81e9f184 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 08b1b860-516e-4041-8df8-1fa8cc65a4ed] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:35.868509 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-b73f81d5-0b0c-44bb-836c-e608b79f5718 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Flavor pref 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 30 12:04:35.869052 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-b73f81d5-0b0c-44bb-836c-e608b79f5718 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Image pref 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 30 12:04:35.871282 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-b73f81d5-0b0c-44bb-836c-e608b79f5718 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 30 12:04:35.873901 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5cb7701e-ed01-4036-801c-dd0e81e9f184 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:35.874355 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5cb7701e-ed01-4036-801c-dd0e81e9f184 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:35.878661 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5cb7701e-ed01-4036-801c-dd0e81e9f184 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:35.878661 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5cb7701e-ed01-4036-801c-dd0e81e9f184 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:35.937633 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b73f81d5-0b0c-44bb-836c-e608b79f5718 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:35.937633 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b73f81d5-0b0c-44bb-836c-e608b79f5718 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:35.937633 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b73f81d5-0b0c-44bb-836c-e608b79f5718 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:35.937633 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b73f81d5-0b0c-44bb-836c-e608b79f5718 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:35.963947 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-5cb7701e-ed01-4036-801c-dd0e81e9f184 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76e8d7bfdc04ea79c83ca7fb6b9ade1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5074cf3e6248668995f266845c8969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:35.964621 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.quota [None req-b73f81d5-0b0c-44bb-836c-e608b79f5718 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Getting quotas for project 20763921c37c4e81bba702e09bf628b2. Resources: {'cores', 'instances', 'ram'} {{(pid=117670) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 30 12:04:35.971969 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.quota [None req-b73f81d5-0b0c-44bb-836c-e608b79f5718 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Getting quotas for user 7575179edbda45208561c983fc5b956c and project 20763921c37c4e81bba702e09bf628b2. Resources: {'cores', 'instances', 'ram'} {{(pid=117670) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 30 12:04:35.974396 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-5cb7701e-ed01-4036-801c-dd0e81e9f184 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed" status: 200 len: 1297 microversion: 2.1 time: 0.111282 May 30 12:04:35.975016 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 17/27] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:04:35 2022] GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed => generated 1297 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:04:35.982456 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-e9084590-3dd1-437e-80b4-e16027bfb866 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:35.983273 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-e9084590-3dd1-437e-80b4-e16027bfb866 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] [instance: 5a06904b-d932-4635-90df-b69dcb15d941] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:35.990545 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e9084590-3dd1-437e-80b4-e16027bfb866 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:35.991110 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e9084590-3dd1-437e-80b4-e16027bfb866 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:35.992342 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e9084590-3dd1-437e-80b4-e16027bfb866 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:35.993240 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e9084590-3dd1-437e-80b4-e16027bfb866 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:35.994131 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-b73f81d5-0b0c-44bb-836c-e608b79f5718 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Going to run 1 instances... {{(pid=117670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 30 12:04:35.996722 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-b73f81d5-0b0c-44bb-836c-e608b79f5718 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: 54ad4de0-2282-4baf-86a4-40d5ba1ba62a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b8ef93ed-af98-4d8c-9e1d-43d7b1f2b832',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 30 12:04:36.076713 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-b73f81d5-0b0c-44bb-836c-e608b79f5718 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 10.159223 May 30 12:04:36.078974 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 11/28] 10.222.0.32 () {60 vars in 1146 bytes} [Mon May 30 12:04:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 10162 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 30 12:04:36.222333 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-e9084590-3dd1-437e-80b4-e16027bfb866 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e591526a8c3645de9c5965a40f8ef90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60b241805384ef49352b3791cfd3d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:36.233925 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-e9084590-3dd1-437e-80b4-e16027bfb866 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] 10.222.0.32 "GET /compute/v2.1/servers/5a06904b-d932-4635-90df-b69dcb15d941" status: 200 len: 1314 microversion: 2.1 time: 0.256985 May 30 12:04:36.235390 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 18/29] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:04:35 2022] GET /compute/v2.1/servers/5a06904b-d932-4635-90df-b69dcb15d941 => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:04:36.256037 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-7a55dd73-569d-4e18-9bbf-74cc720ad503 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1028954527", "imageRef": "b8ef93ed-af98-4d8c-9e1d-43d7b1f2b832", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1b1749ee-1593-44ab-bdce-c8c4ff3a2f62"}], "security_groups": [{"name": "tempest-securitygroup--1579697509"}], "key_name": "tempest-keypair-2112876361", "user_data": "}} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:04:36.419234 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-70b4fd19-585b-4f67-8abe-601a0630182e req-cccd9123-7e7a-4dc5-9696-69d673bb84b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a06904b-d932-4635-90df-b69dcb15d941", "tag": "4fecff73-c0eb-4774-9017-6b7fd73b4455"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:04:36.449958 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-70b4fd19-585b-4f67-8abe-601a0630182e req-cccd9123-7e7a-4dc5-9696-69d673bb84b9 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:36.450851 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-70b4fd19-585b-4f67-8abe-601a0630182e req-cccd9123-7e7a-4dc5-9696-69d673bb84b9 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:36.505821 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-70b4fd19-585b-4f67-8abe-601a0630182e req-cccd9123-7e7a-4dc5-9696-69d673bb84b9 service nova] Creating event network-changed:4fecff73-c0eb-4774-9017-6b7fd73b4455 for instance 5a06904b-d932-4635-90df-b69dcb15d941 on hv-cinder-84051 May 30 12:04:36.506119 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.network.neutron [None req-7a55dd73-569d-4e18-9bbf-74cc720ad503 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] validate_networks() for [('1b1749ee-1593-44ab-bdce-c8c4ff3a2f62', None, None, None, None, None)] {{(pid=117671) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 30 12:04:36.507828 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-70b4fd19-585b-4f67-8abe-601a0630182e req-cccd9123-7e7a-4dc5-9696-69d673bb84b9 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117670) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 30 12:04:36.510142 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-72a3094d-3219-4e4e-815e-bcea8b7b19d3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:36.511268 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-72a3094d-3219-4e4e-815e-bcea8b7b19d3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:36.512879 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-72a3094d-3219-4e4e-815e-bcea8b7b19d3 None None] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:36.515198 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-72a3094d-3219-4e4e-815e-bcea8b7b19d3 None None] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:36.542111 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.compute.rpcapi [None req-72a3094d-3219-4e4e-815e-bcea8b7b19d3 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 30 12:04:36.544128 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-72a3094d-3219-4e4e-815e-bcea8b7b19d3 None None] Releasing lock "compute-rpcapi-router" {{(pid=117670) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 30 12:04:36.578773 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-72a3094d-3219-4e4e-815e-bcea8b7b19d3 None None] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.496911 May 30 12:04:36.581305 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 12/30] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:04:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:04:36.602415 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-4224f676-81cf-4c4a-b3da-78cbb0dd5b4c tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:36.605136 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-4224f676-81cf-4c4a-b3da-78cbb0dd5b4c tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: dcdae5e3-81e8-412d-9e2a-0a481c13b57b] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:36.794504 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-4224f676-81cf-4c4a-b3da-78cbb0dd5b4c tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:36.812280 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-4224f676-81cf-4c4a-b3da-78cbb0dd5b4c tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b" status: 200 len: 1222 microversion: 2.1 time: 0.227569 May 30 12:04:36.815342 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 13/31] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:04:36 2022] GET /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b => generated 1222 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:04:36.821543 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-bc83ce04-f289-4934-bd7a-04f9f89839be tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:36.822576 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-bc83ce04-f289-4934-bd7a-04f9f89839be tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: 54ad4de0-2282-4baf-86a4-40d5ba1ba62a] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:37.047006 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-bc83ce04-f289-4934-bd7a-04f9f89839be tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7575179edbda45208561c983fc5b956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20763921c37c4e81bba702e09bf628b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:37.058172 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-bc83ce04-f289-4934-bd7a-04f9f89839be tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a" status: 200 len: 1241 microversion: 2.1 time: 0.240452 May 30 12:04:37.069516 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 14/32] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:04:36 2022] GET /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a => generated 1241 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:04:37.076081 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-d739d4cf-06ef-4c76-a6db-5aa08f84f570 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:37.077117 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-d739d4cf-06ef-4c76-a6db-5aa08f84f570 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 08b1b860-516e-4041-8df8-1fa8cc65a4ed] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:37.085286 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d739d4cf-06ef-4c76-a6db-5aa08f84f570 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:37.086066 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d739d4cf-06ef-4c76-a6db-5aa08f84f570 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:37.087125 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d739d4cf-06ef-4c76-a6db-5aa08f84f570 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:37.087720 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d739d4cf-06ef-4c76-a6db-5aa08f84f570 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:37.182878 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-d739d4cf-06ef-4c76-a6db-5aa08f84f570 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76e8d7bfdc04ea79c83ca7fb6b9ade1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5074cf3e6248668995f266845c8969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:37.195271 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-d739d4cf-06ef-4c76-a6db-5aa08f84f570 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed" status: 200 len: 1295 microversion: 2.1 time: 0.123720 May 30 12:04:37.195866 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 15/33] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:04:37 2022] GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed => generated 1295 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:04:37.213152 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-59860c9c-3b9b-4e34-bf04-7731ebf69746 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-409064193", "imageRef": "b8ef93ed-af98-4d8c-9e1d-43d7b1f2b832", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:04:37.309468 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.network.neutron [None req-59860c9c-3b9b-4e34-bf04-7731ebf69746 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] validate_networks() for [('1df1af59-dc4a-4ec6-926a-e35a4841adfa', None, None, None, None, None)] {{(pid=117670) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 30 12:04:37.419835 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-7a55dd73-569d-4e18-9bbf-74cc720ad503 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Flavor limits 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 30 12:04:37.420946 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-7a55dd73-569d-4e18-9bbf-74cc720ad503 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Image limits 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 30 12:04:37.421656 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-7a55dd73-569d-4e18-9bbf-74cc720ad503 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Flavor pref 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 30 12:04:37.422238 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-7a55dd73-569d-4e18-9bbf-74cc720ad503 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Image pref 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 30 12:04:37.422959 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-7a55dd73-569d-4e18-9bbf-74cc720ad503 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 30 12:04:37.447156 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7a55dd73-569d-4e18-9bbf-74cc720ad503 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:37.448349 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7a55dd73-569d-4e18-9bbf-74cc720ad503 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:37.451712 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7a55dd73-569d-4e18-9bbf-74cc720ad503 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:37.452524 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7a55dd73-569d-4e18-9bbf-74cc720ad503 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:37.486249 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.quota [None req-7a55dd73-569d-4e18-9bbf-74cc720ad503 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Getting quotas for project 8e98cc41e8064c90b0e45b32e2d78493. Resources: {'cores', 'instances', 'ram'} {{(pid=117671) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 30 12:04:37.490640 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.quota [None req-7a55dd73-569d-4e18-9bbf-74cc720ad503 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Getting quotas for user bc47c5bf77894aefa6ecde115ed9f88f and project 8e98cc41e8064c90b0e45b32e2d78493. Resources: {'cores', 'instances', 'ram'} {{(pid=117671) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 30 12:04:37.509893 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-7a55dd73-569d-4e18-9bbf-74cc720ad503 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Going to run 1 instances... {{(pid=117671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 30 12:04:37.513079 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-7a55dd73-569d-4e18-9bbf-74cc720ad503 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b8ef93ed-af98-4d8c-9e1d-43d7b1f2b832',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 30 12:04:37.598630 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-7a55dd73-569d-4e18-9bbf-74cc720ad503 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.360990 May 30 12:04:37.630038 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 19/34] 10.222.0.32 () {62 vars in 1187 bytes} [Mon May 30 12:04:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 1394 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 30 12:04:37.635850 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-7ba80059-498c-4335-b102-bff056a4427c tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:37.636512 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-7ba80059-498c-4335-b102-bff056a4427c tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] [instance: 5a06904b-d932-4635-90df-b69dcb15d941] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:37.648572 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7ba80059-498c-4335-b102-bff056a4427c tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:37.649296 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7ba80059-498c-4335-b102-bff056a4427c tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:37.652618 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7ba80059-498c-4335-b102-bff056a4427c tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:37.653226 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7ba80059-498c-4335-b102-bff056a4427c tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:38.173086 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-7ba80059-498c-4335-b102-bff056a4427c tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e591526a8c3645de9c5965a40f8ef90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60b241805384ef49352b3791cfd3d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:38.187518 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-7ba80059-498c-4335-b102-bff056a4427c tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] 10.222.0.32 "GET /compute/v2.1/servers/5a06904b-d932-4635-90df-b69dcb15d941" status: 200 len: 1314 microversion: 2.1 time: 0.556293 May 30 12:04:38.188103 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 20/35] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:04:37 2022] GET /compute/v2.1/servers/5a06904b-d932-4635-90df-b69dcb15d941 => generated 1314 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:04:38.200559 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-8ffaeab5-5c34-41ad-bf3d-d8f4ce7491fc tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:38.201157 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-8ffaeab5-5c34-41ad-bf3d-d8f4ce7491fc tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:38.552588 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-8ffaeab5-5c34-41ad-bf3d-d8f4ce7491fc tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:38.560319 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-59860c9c-3b9b-4e34-bf04-7731ebf69746 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Flavor limits 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 30 12:04:38.561507 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-59860c9c-3b9b-4e34-bf04-7731ebf69746 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Image limits 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 30 12:04:38.562230 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-59860c9c-3b9b-4e34-bf04-7731ebf69746 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Flavor pref 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 30 12:04:38.562945 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-59860c9c-3b9b-4e34-bf04-7731ebf69746 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Image pref 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 30 12:04:38.563609 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-59860c9c-3b9b-4e34-bf04-7731ebf69746 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 30 12:04:38.564768 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-8ffaeab5-5c34-41ad-bf3d-d8f4ce7491fc tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:38.566503 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-8ffaeab5-5c34-41ad-bf3d-d8f4ce7491fc tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:38.567641 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-8ffaeab5-5c34-41ad-bf3d-d8f4ce7491fc tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1282 microversion: 2.20 time: 0.378434 May 30 12:04:38.572267 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 21/36] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:04:38 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1282 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:04:38.574193 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-59860c9c-3b9b-4e34-bf04-7731ebf69746 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:38.575047 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-59860c9c-3b9b-4e34-bf04-7731ebf69746 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:38.576082 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-59860c9c-3b9b-4e34-bf04-7731ebf69746 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:38.576748 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-59860c9c-3b9b-4e34-bf04-7731ebf69746 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:38.576992 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-81d4d68c-98e4-455e-8c44-2943aec9217a tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:38.577600 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-81d4d68c-98e4-455e-8c44-2943aec9217a tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: 54ad4de0-2282-4baf-86a4-40d5ba1ba62a] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:38.604311 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-81d4d68c-98e4-455e-8c44-2943aec9217a tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:38.605072 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-81d4d68c-98e4-455e-8c44-2943aec9217a tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:38.606937 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-81d4d68c-98e4-455e-8c44-2943aec9217a tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:38.607785 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-81d4d68c-98e4-455e-8c44-2943aec9217a tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:38.617866 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.quota [None req-59860c9c-3b9b-4e34-bf04-7731ebf69746 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Getting quotas for project c988db8e79bf4c98ac288105177f90f2. Resources: {'cores', 'instances', 'ram'} {{(pid=117670) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 30 12:04:38.628946 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.quota [None req-59860c9c-3b9b-4e34-bf04-7731ebf69746 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Getting quotas for user 166b42a5d6c04659afb20c088dfead76 and project c988db8e79bf4c98ac288105177f90f2. Resources: {'cores', 'instances', 'ram'} {{(pid=117670) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 30 12:04:38.655793 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-59860c9c-3b9b-4e34-bf04-7731ebf69746 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Going to run 1 instances... {{(pid=117670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 30 12:04:38.665985 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-59860c9c-3b9b-4e34-bf04-7731ebf69746 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 8542b17d-0c65-4c5d-bc97-9d17545e2126] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b8ef93ed-af98-4d8c-9e1d-43d7b1f2b832',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 30 12:04:38.705289 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-81d4d68c-98e4-455e-8c44-2943aec9217a tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7575179edbda45208561c983fc5b956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20763921c37c4e81bba702e09bf628b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:38.720188 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-81d4d68c-98e4-455e-8c44-2943aec9217a tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a" status: 200 len: 1299 microversion: 2.1 time: 0.145412 May 30 12:04:38.733630 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 22/37] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:04:38 2022] GET /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a => generated 1299 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:04:38.735599 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-1b5e791f-deab-4029-b5c8-9d6545eafd31 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:38.737361 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-1b5e791f-deab-4029-b5c8-9d6545eafd31 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 08b1b860-516e-4041-8df8-1fa8cc65a4ed] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:38.748986 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1b5e791f-deab-4029-b5c8-9d6545eafd31 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:38.751210 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1b5e791f-deab-4029-b5c8-9d6545eafd31 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:38.754548 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1b5e791f-deab-4029-b5c8-9d6545eafd31 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:38.755193 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1b5e791f-deab-4029-b5c8-9d6545eafd31 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:38.857533 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-59860c9c-3b9b-4e34-bf04-7731ebf69746 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.659278 May 30 12:04:38.858470 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 16/38] 10.222.0.32 () {60 vars in 1146 bytes} [Mon May 30 12:04:37 2022] POST /compute/v2.1/servers => generated 383 bytes in 1662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 30 12:04:38.882391 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-728a03f4-37e4-442e-9038-73dc9a56fe24 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:38.887883 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-728a03f4-37e4-442e-9038-73dc9a56fe24 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 8542b17d-0c65-4c5d-bc97-9d17545e2126] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:38.991313 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-1b5e791f-deab-4029-b5c8-9d6545eafd31 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76e8d7bfdc04ea79c83ca7fb6b9ade1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5074cf3e6248668995f266845c8969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:39.004224 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-1b5e791f-deab-4029-b5c8-9d6545eafd31 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed" status: 200 len: 1295 microversion: 2.1 time: 0.275923 May 30 12:04:39.005517 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 23/39] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:04:38 2022] GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed => generated 1295 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:04:39.055220 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-728a03f4-37e4-442e-9038-73dc9a56fe24 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:39.079669 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-728a03f4-37e4-442e-9038-73dc9a56fe24 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126" status: 200 len: 1221 microversion: 2.1 time: 0.210920 May 30 12:04:39.084301 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 17/40] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:04:38 2022] GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126 => generated 1221 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:04:39.207303 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-da9e4ea4-9458-4b8c-b17f-547e4517ad6b tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:39.208083 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-da9e4ea4-9458-4b8c-b17f-547e4517ad6b tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] [instance: 5a06904b-d932-4635-90df-b69dcb15d941] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:39.225185 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-da9e4ea4-9458-4b8c-b17f-547e4517ad6b tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:39.226539 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-da9e4ea4-9458-4b8c-b17f-547e4517ad6b tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:39.229263 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-da9e4ea4-9458-4b8c-b17f-547e4517ad6b tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:39.230654 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-da9e4ea4-9458-4b8c-b17f-547e4517ad6b tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:39.560675 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-da9e4ea4-9458-4b8c-b17f-547e4517ad6b tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e591526a8c3645de9c5965a40f8ef90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60b241805384ef49352b3791cfd3d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:39.575332 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-da9e4ea4-9458-4b8c-b17f-547e4517ad6b tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] 10.222.0.32 "GET /compute/v2.1/servers/5a06904b-d932-4635-90df-b69dcb15d941" status: 200 len: 1314 microversion: 2.1 time: 0.373601 May 30 12:04:39.576471 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 24/41] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:04:39 2022] GET /compute/v2.1/servers/5a06904b-d932-4635-90df-b69dcb15d941 => generated 1314 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:04:39.599532 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-67fefd48-c1b6-4d7f-a02a-5720a38374c8 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:39.604352 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-67fefd48-c1b6-4d7f-a02a-5720a38374c8 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:39.619122 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-67fefd48-c1b6-4d7f-a02a-5720a38374c8 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:39.619122 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-67fefd48-c1b6-4d7f-a02a-5720a38374c8 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:39.622618 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-67fefd48-c1b6-4d7f-a02a-5720a38374c8 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:39.624634 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-67fefd48-c1b6-4d7f-a02a-5720a38374c8 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:39.741330 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-2c3a4c0a-afaa-41b7-9c27-a8407d4d02ea tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:39.742138 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-2c3a4c0a-afaa-41b7-9c27-a8407d4d02ea tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: 54ad4de0-2282-4baf-86a4-40d5ba1ba62a] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:39.748506 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2c3a4c0a-afaa-41b7-9c27-a8407d4d02ea tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:39.748957 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2c3a4c0a-afaa-41b7-9c27-a8407d4d02ea tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:39.749735 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2c3a4c0a-afaa-41b7-9c27-a8407d4d02ea tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:39.750165 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2c3a4c0a-afaa-41b7-9c27-a8407d4d02ea tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:39.787802 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-67fefd48-c1b6-4d7f-a02a-5720a38374c8 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:39.799371 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-67fefd48-c1b6-4d7f-a02a-5720a38374c8 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:39.801524 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-67fefd48-c1b6-4d7f-a02a-5720a38374c8 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:39.804556 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-67fefd48-c1b6-4d7f-a02a-5720a38374c8 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1334 microversion: 2.20 time: 0.216418 May 30 12:04:39.805751 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 18/42] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:04:39 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1334 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:04:39.854888 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-2c3a4c0a-afaa-41b7-9c27-a8407d4d02ea tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7575179edbda45208561c983fc5b956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20763921c37c4e81bba702e09bf628b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:39.864249 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-2c3a4c0a-afaa-41b7-9c27-a8407d4d02ea tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a" status: 200 len: 1299 microversion: 2.1 time: 0.126762 May 30 12:04:39.865016 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 25/43] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:04:39 2022] GET /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a => generated 1299 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:04:40.030190 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-20359368-d20f-400f-897d-e02515022970 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:40.030823 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-20359368-d20f-400f-897d-e02515022970 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 08b1b860-516e-4041-8df8-1fa8cc65a4ed] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:40.038222 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-20359368-d20f-400f-897d-e02515022970 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:40.038673 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-20359368-d20f-400f-897d-e02515022970 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:40.039490 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-20359368-d20f-400f-897d-e02515022970 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:40.039937 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-20359368-d20f-400f-897d-e02515022970 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:40.105104 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-d015c325-f6f0-4118-9c52-f8d49781ef19 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:40.105741 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-d015c325-f6f0-4118-9c52-f8d49781ef19 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 8542b17d-0c65-4c5d-bc97-9d17545e2126] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:40.114238 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d015c325-f6f0-4118-9c52-f8d49781ef19 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:40.114691 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d015c325-f6f0-4118-9c52-f8d49781ef19 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:40.116293 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d015c325-f6f0-4118-9c52-f8d49781ef19 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:40.116972 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d015c325-f6f0-4118-9c52-f8d49781ef19 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:40.208567 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-d015c325-f6f0-4118-9c52-f8d49781ef19 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:40.217837 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-d015c325-f6f0-4118-9c52-f8d49781ef19 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126" status: 200 len: 1225 microversion: 2.1 time: 0.117107 May 30 12:04:40.228633 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 26/44] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:04:40 2022] GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126 => generated 1225 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:04:40.252844 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-20359368-d20f-400f-897d-e02515022970 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76e8d7bfdc04ea79c83ca7fb6b9ade1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5074cf3e6248668995f266845c8969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:40.261003 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-20359368-d20f-400f-897d-e02515022970 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed" status: 200 len: 1362 microversion: 2.1 time: 0.234770 May 30 12:04:40.261592 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 19/45] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:04:40 2022] GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed => generated 1362 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:04:40.594750 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-86cfb051-8324-4f96-8e12-bf65f5a4fe8e tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:40.595461 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-86cfb051-8324-4f96-8e12-bf65f5a4fe8e tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] [instance: 5a06904b-d932-4635-90df-b69dcb15d941] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:40.601529 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-86cfb051-8324-4f96-8e12-bf65f5a4fe8e tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:40.601978 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-86cfb051-8324-4f96-8e12-bf65f5a4fe8e tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:40.602740 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-86cfb051-8324-4f96-8e12-bf65f5a4fe8e tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:40.603178 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-86cfb051-8324-4f96-8e12-bf65f5a4fe8e tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:40.746590 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-86cfb051-8324-4f96-8e12-bf65f5a4fe8e tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e591526a8c3645de9c5965a40f8ef90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60b241805384ef49352b3791cfd3d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:40.755930 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-86cfb051-8324-4f96-8e12-bf65f5a4fe8e tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] 10.222.0.32 "GET /compute/v2.1/servers/5a06904b-d932-4635-90df-b69dcb15d941" status: 200 len: 1314 microversion: 2.1 time: 0.165400 May 30 12:04:40.756701 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 27/46] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:04:40 2022] GET /compute/v2.1/servers/5a06904b-d932-4635-90df-b69dcb15d941 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:04:40.822634 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-83385c75-ca1b-4925-bcb2-c8bad2f70dc4 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:40.823525 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-83385c75-ca1b-4925-bcb2-c8bad2f70dc4 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:40.829695 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-83385c75-ca1b-4925-bcb2-c8bad2f70dc4 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:40.830634 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-83385c75-ca1b-4925-bcb2-c8bad2f70dc4 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:40.831429 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-83385c75-ca1b-4925-bcb2-c8bad2f70dc4 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:40.832000 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-83385c75-ca1b-4925-bcb2-c8bad2f70dc4 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:40.881742 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-3931fba9-24a9-44a8-af0c-06f4a04a901b tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:40.882339 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-3931fba9-24a9-44a8-af0c-06f4a04a901b tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: 54ad4de0-2282-4baf-86a4-40d5ba1ba62a] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:40.890944 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3931fba9-24a9-44a8-af0c-06f4a04a901b tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:40.895802 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3931fba9-24a9-44a8-af0c-06f4a04a901b tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:40.895802 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3931fba9-24a9-44a8-af0c-06f4a04a901b tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:40.895802 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3931fba9-24a9-44a8-af0c-06f4a04a901b tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:40.903396 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-83385c75-ca1b-4925-bcb2-c8bad2f70dc4 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:40.911916 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-83385c75-ca1b-4925-bcb2-c8bad2f70dc4 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:40.913452 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-83385c75-ca1b-4925-bcb2-c8bad2f70dc4 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:40.914551 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-83385c75-ca1b-4925-bcb2-c8bad2f70dc4 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1334 microversion: 2.20 time: 0.095831 May 30 12:04:40.915107 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 20/47] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:04:40 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1334 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:04:40.969359 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-3931fba9-24a9-44a8-af0c-06f4a04a901b tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7575179edbda45208561c983fc5b956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20763921c37c4e81bba702e09bf628b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:40.977271 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-3931fba9-24a9-44a8-af0c-06f4a04a901b tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a" status: 200 len: 1299 microversion: 2.1 time: 0.099514 May 30 12:04:40.977981 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 28/48] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:04:40 2022] GET /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a => generated 1299 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:04:41.238560 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-6666f965-2399-477c-8e1c-5e756aeacff2 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:41.239267 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-6666f965-2399-477c-8e1c-5e756aeacff2 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 8542b17d-0c65-4c5d-bc97-9d17545e2126] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:41.246197 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6666f965-2399-477c-8e1c-5e756aeacff2 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:41.246792 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6666f965-2399-477c-8e1c-5e756aeacff2 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:41.247752 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6666f965-2399-477c-8e1c-5e756aeacff2 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:41.248397 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6666f965-2399-477c-8e1c-5e756aeacff2 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:41.279064 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-98bbecc3-0296-43fd-9a1c-0fd1427e62c3 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:41.279847 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-98bbecc3-0296-43fd-9a1c-0fd1427e62c3 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 08b1b860-516e-4041-8df8-1fa8cc65a4ed] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:41.293286 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-98bbecc3-0296-43fd-9a1c-0fd1427e62c3 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:41.293938 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-98bbecc3-0296-43fd-9a1c-0fd1427e62c3 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:41.296898 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-98bbecc3-0296-43fd-9a1c-0fd1427e62c3 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:41.297499 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-98bbecc3-0296-43fd-9a1c-0fd1427e62c3 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:41.319182 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-6666f965-2399-477c-8e1c-5e756aeacff2 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:41.329176 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-6666f965-2399-477c-8e1c-5e756aeacff2 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126" status: 200 len: 1225 microversion: 2.1 time: 0.096906 May 30 12:04:41.330713 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 21/49] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:04:41 2022] GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126 => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:04:41.448821 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-98bbecc3-0296-43fd-9a1c-0fd1427e62c3 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76e8d7bfdc04ea79c83ca7fb6b9ade1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5074cf3e6248668995f266845c8969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:41.457803 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-98bbecc3-0296-43fd-9a1c-0fd1427e62c3 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed" status: 200 len: 1362 microversion: 2.1 time: 0.182763 May 30 12:04:41.458453 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 29/50] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:04:41 2022] GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed => generated 1362 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:04:41.774583 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-77a64dab-12fc-49c6-a916-72a6c6c68668 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:41.775279 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-77a64dab-12fc-49c6-a916-72a6c6c68668 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] [instance: 5a06904b-d932-4635-90df-b69dcb15d941] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:41.781199 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-77a64dab-12fc-49c6-a916-72a6c6c68668 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:41.781648 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-77a64dab-12fc-49c6-a916-72a6c6c68668 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:41.783448 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-77a64dab-12fc-49c6-a916-72a6c6c68668 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:41.783448 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-77a64dab-12fc-49c6-a916-72a6c6c68668 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:41.927290 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-77a64dab-12fc-49c6-a916-72a6c6c68668 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e591526a8c3645de9c5965a40f8ef90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60b241805384ef49352b3791cfd3d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:41.934388 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-fb77fbea-5383-4e06-9639-a1f68209c649 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:41.934832 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-77a64dab-12fc-49c6-a916-72a6c6c68668 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] 10.222.0.32 "GET /compute/v2.1/servers/5a06904b-d932-4635-90df-b69dcb15d941" status: 200 len: 1314 microversion: 2.1 time: 0.164015 May 30 12:04:41.934924 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-fb77fbea-5383-4e06-9639-a1f68209c649 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:41.935413 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 22/51] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:04:41 2022] GET /compute/v2.1/servers/5a06904b-d932-4635-90df-b69dcb15d941 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:04:41.941814 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-fb77fbea-5383-4e06-9639-a1f68209c649 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:41.942266 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-fb77fbea-5383-4e06-9639-a1f68209c649 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:41.943033 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-fb77fbea-5383-4e06-9639-a1f68209c649 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:41.943470 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-fb77fbea-5383-4e06-9639-a1f68209c649 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:41.997320 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-68e94000-7f53-4a31-9e86-629becab621e tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:41.997937 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-68e94000-7f53-4a31-9e86-629becab621e tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: 54ad4de0-2282-4baf-86a4-40d5ba1ba62a] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:42.004978 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-68e94000-7f53-4a31-9e86-629becab621e tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:42.005429 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-68e94000-7f53-4a31-9e86-629becab621e tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:42.005645 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-fb77fbea-5383-4e06-9639-a1f68209c649 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:42.006193 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-68e94000-7f53-4a31-9e86-629becab621e tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:42.006638 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-68e94000-7f53-4a31-9e86-629becab621e tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:42.013768 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-fb77fbea-5383-4e06-9639-a1f68209c649 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:42.015297 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-fb77fbea-5383-4e06-9639-a1f68209c649 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:42.016947 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-fb77fbea-5383-4e06-9639-a1f68209c649 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1334 microversion: 2.20 time: 0.086339 May 30 12:04:42.018015 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 30/52] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:04:41 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1334 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:04:42.070650 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-68e94000-7f53-4a31-9e86-629becab621e tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7575179edbda45208561c983fc5b956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20763921c37c4e81bba702e09bf628b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:42.078179 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-68e94000-7f53-4a31-9e86-629becab621e tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a" status: 200 len: 1299 microversion: 2.1 time: 0.084777 May 30 12:04:42.078747 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 23/53] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:04:41 2022] GET /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a => generated 1299 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:04:42.346108 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-8311c1d5-acbb-4e4a-8413-971c30229133 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:42.346722 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-8311c1d5-acbb-4e4a-8413-971c30229133 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 8542b17d-0c65-4c5d-bc97-9d17545e2126] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:42.352890 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8311c1d5-acbb-4e4a-8413-971c30229133 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:42.353327 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8311c1d5-acbb-4e4a-8413-971c30229133 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:42.354084 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8311c1d5-acbb-4e4a-8413-971c30229133 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:42.354514 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8311c1d5-acbb-4e4a-8413-971c30229133 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:42.417461 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-8311c1d5-acbb-4e4a-8413-971c30229133 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:42.426756 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-8311c1d5-acbb-4e4a-8413-971c30229133 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126" status: 200 len: 1225 microversion: 2.1 time: 0.084357 May 30 12:04:42.427331 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 31/54] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:04:42 2022] GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:04:42.475095 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-b2401516-0965-430c-aa80-b1a914a9eb52 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:42.475712 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-b2401516-0965-430c-aa80-b1a914a9eb52 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 08b1b860-516e-4041-8df8-1fa8cc65a4ed] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:42.481717 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b2401516-0965-430c-aa80-b1a914a9eb52 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:42.482170 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b2401516-0965-430c-aa80-b1a914a9eb52 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:42.482978 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b2401516-0965-430c-aa80-b1a914a9eb52 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:42.483403 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b2401516-0965-430c-aa80-b1a914a9eb52 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:42.621101 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-b2401516-0965-430c-aa80-b1a914a9eb52 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76e8d7bfdc04ea79c83ca7fb6b9ade1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5074cf3e6248668995f266845c8969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:42.629617 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-b2401516-0965-430c-aa80-b1a914a9eb52 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed" status: 200 len: 1362 microversion: 2.1 time: 0.158511 May 30 12:04:42.630189 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 24/55] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:04:42 2022] GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:04:42.952898 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-eb486266-3ea9-4c42-80b2-098670703ef7 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:42.953873 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-eb486266-3ea9-4c42-80b2-098670703ef7 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] [instance: 5a06904b-d932-4635-90df-b69dcb15d941] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:42.973065 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-eb486266-3ea9-4c42-80b2-098670703ef7 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:42.973647 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-eb486266-3ea9-4c42-80b2-098670703ef7 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:42.974315 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-eb486266-3ea9-4c42-80b2-098670703ef7 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:42.974749 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-eb486266-3ea9-4c42-80b2-098670703ef7 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:43.035461 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-7546b484-e0e4-4e79-aafc-85f9b23bbc20 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:43.036085 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-7546b484-e0e4-4e79-aafc-85f9b23bbc20 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:43.042851 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7546b484-e0e4-4e79-aafc-85f9b23bbc20 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:43.043858 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7546b484-e0e4-4e79-aafc-85f9b23bbc20 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:43.044851 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7546b484-e0e4-4e79-aafc-85f9b23bbc20 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:43.045573 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7546b484-e0e4-4e79-aafc-85f9b23bbc20 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:43.176851 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-7546b484-e0e4-4e79-aafc-85f9b23bbc20 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:43.191323 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-7546b484-e0e4-4e79-aafc-85f9b23bbc20 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:43.196691 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-7546b484-e0e4-4e79-aafc-85f9b23bbc20 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:43.199954 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-7546b484-e0e4-4e79-aafc-85f9b23bbc20 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1334 microversion: 2.20 time: 0.168989 May 30 12:04:43.202725 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 25/56] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:04:43 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1334 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 30 12:04:43.209272 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-0aad28c1-51a8-4d34-afdd-47a6030be51d tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:43.213391 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-0aad28c1-51a8-4d34-afdd-47a6030be51d tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: 54ad4de0-2282-4baf-86a4-40d5ba1ba62a] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:43.221306 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-0aad28c1-51a8-4d34-afdd-47a6030be51d tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:43.222062 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-0aad28c1-51a8-4d34-afdd-47a6030be51d tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:43.223176 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-0aad28c1-51a8-4d34-afdd-47a6030be51d tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:43.223764 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-0aad28c1-51a8-4d34-afdd-47a6030be51d tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:43.368686 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-0aad28c1-51a8-4d34-afdd-47a6030be51d tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7575179edbda45208561c983fc5b956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20763921c37c4e81bba702e09bf628b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:43.382220 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-0aad28c1-51a8-4d34-afdd-47a6030be51d tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a" status: 200 len: 1299 microversion: 2.1 time: 0.178143 May 30 12:04:43.383414 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-eb486266-3ea9-4c42-80b2-098670703ef7 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e591526a8c3645de9c5965a40f8ef90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60b241805384ef49352b3791cfd3d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:43.392853 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 26/57] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:04:43 2022] GET /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a => generated 1299 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:04:43.402349 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-eb486266-3ea9-4c42-80b2-098670703ef7 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] 10.222.0.32 "GET /compute/v2.1/servers/5a06904b-d932-4635-90df-b69dcb15d941" status: 200 len: 1314 microversion: 2.1 time: 0.454470 May 30 12:04:43.408746 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 32/58] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:04:42 2022] GET /compute/v2.1/servers/5a06904b-d932-4635-90df-b69dcb15d941 => generated 1314 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:04:43.446386 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-a2cfb769-2aa0-4e24-9e6d-5cbeb7d193ab tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:43.447845 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-a2cfb769-2aa0-4e24-9e6d-5cbeb7d193ab tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 8542b17d-0c65-4c5d-bc97-9d17545e2126] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:43.457807 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a2cfb769-2aa0-4e24-9e6d-5cbeb7d193ab tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:43.458943 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a2cfb769-2aa0-4e24-9e6d-5cbeb7d193ab tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:43.460903 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a2cfb769-2aa0-4e24-9e6d-5cbeb7d193ab tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:43.461896 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a2cfb769-2aa0-4e24-9e6d-5cbeb7d193ab tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:43.578816 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-a2cfb769-2aa0-4e24-9e6d-5cbeb7d193ab tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:43.592327 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-a2cfb769-2aa0-4e24-9e6d-5cbeb7d193ab tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126" status: 200 len: 1273 microversion: 2.1 time: 0.145817 May 30 12:04:43.592327 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 27/59] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:04:43 2022] GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126 => generated 1273 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:04:43.647397 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-c3905294-96fa-4d2c-82b7-5f87fccf8c4e tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:43.648391 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-c3905294-96fa-4d2c-82b7-5f87fccf8c4e tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 08b1b860-516e-4041-8df8-1fa8cc65a4ed] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:43.655629 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c3905294-96fa-4d2c-82b7-5f87fccf8c4e tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:43.660832 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c3905294-96fa-4d2c-82b7-5f87fccf8c4e tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:43.661674 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c3905294-96fa-4d2c-82b7-5f87fccf8c4e tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:43.662123 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c3905294-96fa-4d2c-82b7-5f87fccf8c4e tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:44.044103 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-c3905294-96fa-4d2c-82b7-5f87fccf8c4e tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76e8d7bfdc04ea79c83ca7fb6b9ade1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5074cf3e6248668995f266845c8969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:44.052580 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-c3905294-96fa-4d2c-82b7-5f87fccf8c4e tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed" status: 200 len: 1362 microversion: 2.1 time: 0.409297 May 30 12:04:44.053493 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 33/60] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:04:43 2022] GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed => generated 1362 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:04:44.221914 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-55e17161-061f-4888-aa96-0b6d82f50cae tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:44.222568 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-55e17161-061f-4888-aa96-0b6d82f50cae tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:44.232433 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-55e17161-061f-4888-aa96-0b6d82f50cae tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:44.233222 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-55e17161-061f-4888-aa96-0b6d82f50cae tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:44.234103 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-55e17161-061f-4888-aa96-0b6d82f50cae tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:44.234546 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-55e17161-061f-4888-aa96-0b6d82f50cae tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:44.400211 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-55e17161-061f-4888-aa96-0b6d82f50cae tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:44.404267 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-baf18e53-0b2a-46aa-adb6-faf3c88323d0 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:44.405075 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-baf18e53-0b2a-46aa-adb6-faf3c88323d0 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: 54ad4de0-2282-4baf-86a4-40d5ba1ba62a] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:44.431831 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-55e17161-061f-4888-aa96-0b6d82f50cae tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:44.433311 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-baf18e53-0b2a-46aa-adb6-faf3c88323d0 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:44.435299 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-55e17161-061f-4888-aa96-0b6d82f50cae tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:44.437283 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-baf18e53-0b2a-46aa-adb6-faf3c88323d0 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:44.438384 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-baf18e53-0b2a-46aa-adb6-faf3c88323d0 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:44.440340 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-55e17161-061f-4888-aa96-0b6d82f50cae tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1340 microversion: 2.20 time: 0.223922 May 30 12:04:44.441270 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-baf18e53-0b2a-46aa-adb6-faf3c88323d0 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:44.446724 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 28/61] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:04:44 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1340 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:04:44.458131 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-3035e636-5562-4f5e-9cf9-81cba1ca6faa tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:44.460912 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-3035e636-5562-4f5e-9cf9-81cba1ca6faa tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] [instance: 5a06904b-d932-4635-90df-b69dcb15d941] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:44.523260 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3035e636-5562-4f5e-9cf9-81cba1ca6faa tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:44.524629 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3035e636-5562-4f5e-9cf9-81cba1ca6faa tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:44.536428 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3035e636-5562-4f5e-9cf9-81cba1ca6faa tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:44.537264 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3035e636-5562-4f5e-9cf9-81cba1ca6faa tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:44.886542 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-3035e636-5562-4f5e-9cf9-81cba1ca6faa tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e591526a8c3645de9c5965a40f8ef90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60b241805384ef49352b3791cfd3d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:44.894284 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-3035e636-5562-4f5e-9cf9-81cba1ca6faa tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] 10.222.0.32 "GET /compute/v2.1/servers/5a06904b-d932-4635-90df-b69dcb15d941" status: 200 len: 1314 microversion: 2.1 time: 0.446029 May 30 12:04:44.895132 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 29/62] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:04:44 2022] GET /compute/v2.1/servers/5a06904b-d932-4635-90df-b69dcb15d941 => generated 1314 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:04:44.917551 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-baf18e53-0b2a-46aa-adb6-faf3c88323d0 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7575179edbda45208561c983fc5b956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20763921c37c4e81bba702e09bf628b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:44.923538 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-7cd9068c-5ac3-47c3-a5e6-eafc33d642d1 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:44.924350 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-7cd9068c-5ac3-47c3-a5e6-eafc33d642d1 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 8542b17d-0c65-4c5d-bc97-9d17545e2126] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:44.933801 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-baf18e53-0b2a-46aa-adb6-faf3c88323d0 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a" status: 200 len: 1367 microversion: 2.1 time: 0.537117 May 30 12:04:44.935660 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7cd9068c-5ac3-47c3-a5e6-eafc33d642d1 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:44.936125 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7cd9068c-5ac3-47c3-a5e6-eafc33d642d1 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:44.936945 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7cd9068c-5ac3-47c3-a5e6-eafc33d642d1 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:44.937552 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7cd9068c-5ac3-47c3-a5e6-eafc33d642d1 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:44.942464 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 34/63] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:04:44 2022] GET /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a => generated 1367 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:04:44.948073 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-e6326031-5f58-4d9f-a83d-92c14408d4e5 req-cd5a23a9-e3c7-41c0-a8b8-48eaa5393ce9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08b1b860-516e-4041-8df8-1fa8cc65a4ed", "tag": "2d71add9-9fe3-4c66-b490-513b1ce61d40"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:04:44.963553 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-e6326031-5f58-4d9f-a83d-92c14408d4e5 req-cd5a23a9-e3c7-41c0-a8b8-48eaa5393ce9 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:44.971705 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-e6326031-5f58-4d9f-a83d-92c14408d4e5 req-cd5a23a9-e3c7-41c0-a8b8-48eaa5393ce9 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:44.992026 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell1:SELECT=100 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:04:45.003989 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-e6326031-5f58-4d9f-a83d-92c14408d4e5 req-cd5a23a9-e3c7-41c0-a8b8-48eaa5393ce9 service nova] Creating event network-changed:2d71add9-9fe3-4c66-b490-513b1ce61d40 for instance 08b1b860-516e-4041-8df8-1fa8cc65a4ed on hv-cinder-84051 May 30 12:04:45.005685 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-e6326031-5f58-4d9f-a83d-92c14408d4e5 req-cd5a23a9-e3c7-41c0-a8b8-48eaa5393ce9 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117671) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 30 12:04:45.006941 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-241d3cef-cd58-4461-b21c-5c220bca3783 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:45.015972 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-241d3cef-cd58-4461-b21c-5c220bca3783 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:45.017637 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-241d3cef-cd58-4461-b21c-5c220bca3783 None None] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:45.018091 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-241d3cef-cd58-4461-b21c-5c220bca3783 None None] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:45.023918 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-7cd9068c-5ac3-47c3-a5e6-eafc33d642d1 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:45.033391 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-7cd9068c-5ac3-47c3-a5e6-eafc33d642d1 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126" status: 200 len: 1273 microversion: 2.1 time: 0.121738 May 30 12:04:45.034755 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 30/64] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:04:44 2022] GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126 => generated 1273 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:04:45.038316 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.compute.rpcapi [None req-241d3cef-cd58-4461-b21c-5c220bca3783 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 30 12:04:45.039488 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-241d3cef-cd58-4461-b21c-5c220bca3783 None None] Releasing lock "compute-rpcapi-router" {{(pid=117671) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 30 12:04:45.058735 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-241d3cef-cd58-4461-b21c-5c220bca3783 None None] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114674 May 30 12:04:45.059993 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 35/65] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:04:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:04:45.071960 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-599cca5d-f20a-4cdc-b111-af6917ec32ee tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:45.072712 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-599cca5d-f20a-4cdc-b111-af6917ec32ee tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 08b1b860-516e-4041-8df8-1fa8cc65a4ed] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:45.080321 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-599cca5d-f20a-4cdc-b111-af6917ec32ee tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:45.080783 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-599cca5d-f20a-4cdc-b111-af6917ec32ee tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:45.081561 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-599cca5d-f20a-4cdc-b111-af6917ec32ee tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:45.081995 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-599cca5d-f20a-4cdc-b111-af6917ec32ee tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:45.117264 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-c360179a-2e8a-49d7-a9bd-af0fc410b83a req-6cdf7e6d-0c3e-4a69-9803-a71ad221b4ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcdae5e3-81e8-412d-9e2a-0a481c13b57b", "tag": "4002c1fa-42e8-4916-ae13-112447234689"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:04:45.128685 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-c360179a-2e8a-49d7-a9bd-af0fc410b83a req-6cdf7e6d-0c3e-4a69-9803-a71ad221b4ac service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:45.128685 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-c360179a-2e8a-49d7-a9bd-af0fc410b83a req-6cdf7e6d-0c3e-4a69-9803-a71ad221b4ac service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:45.138938 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-c360179a-2e8a-49d7-a9bd-af0fc410b83a req-6cdf7e6d-0c3e-4a69-9803-a71ad221b4ac service nova] Creating event network-changed:4002c1fa-42e8-4916-ae13-112447234689 for instance dcdae5e3-81e8-412d-9e2a-0a481c13b57b on hv-cinder-84051 May 30 12:04:45.147101 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-c360179a-2e8a-49d7-a9bd-af0fc410b83a req-6cdf7e6d-0c3e-4a69-9803-a71ad221b4ac service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110906 May 30 12:04:45.147939 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 31/66] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:04:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:04:45.231686 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-599cca5d-f20a-4cdc-b111-af6917ec32ee tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76e8d7bfdc04ea79c83ca7fb6b9ade1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5074cf3e6248668995f266845c8969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:45.239617 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-599cca5d-f20a-4cdc-b111-af6917ec32ee tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed" status: 200 len: 1362 microversion: 2.1 time: 0.173053 May 30 12:04:45.240201 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 36/67] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:04:45 2022] GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:04:45.465183 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-ac801f76-1b55-42a4-ace4-748dc5c00da9 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:45.465798 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-ac801f76-1b55-42a4-ace4-748dc5c00da9 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:45.472184 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ac801f76-1b55-42a4-ace4-748dc5c00da9 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:45.472668 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ac801f76-1b55-42a4-ace4-748dc5c00da9 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:45.473445 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ac801f76-1b55-42a4-ace4-748dc5c00da9 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:45.473887 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ac801f76-1b55-42a4-ace4-748dc5c00da9 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:45.539678 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-ac801f76-1b55-42a4-ace4-748dc5c00da9 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:45.543228 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell1:SELECT=100 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:04:45.549709 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-ac801f76-1b55-42a4-ace4-748dc5c00da9 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:45.551241 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-ac801f76-1b55-42a4-ace4-748dc5c00da9 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:45.552387 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-ac801f76-1b55-42a4-ace4-748dc5c00da9 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1340 microversion: 2.20 time: 0.091638 May 30 12:04:45.552953 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 32/68] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:04:45 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1340 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:04:45.912168 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-cb56f31a-3bbc-4e2e-b01a-77916e819473 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:45.912789 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-cb56f31a-3bbc-4e2e-b01a-77916e819473 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] [instance: 5a06904b-d932-4635-90df-b69dcb15d941] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:45.918809 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-cb56f31a-3bbc-4e2e-b01a-77916e819473 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:45.919248 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-cb56f31a-3bbc-4e2e-b01a-77916e819473 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:45.919997 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-cb56f31a-3bbc-4e2e-b01a-77916e819473 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:45.920450 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-cb56f31a-3bbc-4e2e-b01a-77916e819473 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:45.959873 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-5d459894-89fa-4dbf-bd62-16ce9dbdfaeb tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:45.960517 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-5d459894-89fa-4dbf-bd62-16ce9dbdfaeb tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: 54ad4de0-2282-4baf-86a4-40d5ba1ba62a] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:45.966673 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5d459894-89fa-4dbf-bd62-16ce9dbdfaeb tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:45.967116 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5d459894-89fa-4dbf-bd62-16ce9dbdfaeb tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:45.968002 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5d459894-89fa-4dbf-bd62-16ce9dbdfaeb tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:45.968475 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5d459894-89fa-4dbf-bd62-16ce9dbdfaeb tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:46.077485 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-cb56f31a-3bbc-4e2e-b01a-77916e819473 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e591526a8c3645de9c5965a40f8ef90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60b241805384ef49352b3791cfd3d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:46.090427 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-cb56f31a-3bbc-4e2e-b01a-77916e819473 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] 10.222.0.32 "GET /compute/v2.1/servers/5a06904b-d932-4635-90df-b69dcb15d941" status: 200 len: 1314 microversion: 2.1 time: 0.182772 May 30 12:04:46.095501 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 37/69] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:04:45 2022] GET /compute/v2.1/servers/5a06904b-d932-4635-90df-b69dcb15d941 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:04:46.106190 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-d265a249-ff74-4349-9e0f-d6577277276a tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:46.107276 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-d265a249-ff74-4349-9e0f-d6577277276a tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 8542b17d-0c65-4c5d-bc97-9d17545e2126] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:46.123240 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d265a249-ff74-4349-9e0f-d6577277276a tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:46.123696 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d265a249-ff74-4349-9e0f-d6577277276a tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:46.124516 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d265a249-ff74-4349-9e0f-d6577277276a tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:46.124949 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d265a249-ff74-4349-9e0f-d6577277276a tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:46.249090 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-d265a249-ff74-4349-9e0f-d6577277276a tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:46.258186 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-d265a249-ff74-4349-9e0f-d6577277276a tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126" status: 200 len: 1273 microversion: 2.1 time: 0.161306 May 30 12:04:46.258765 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 38/70] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:04:46 2022] GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126 => generated 1273 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:04:46.271047 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-2f07dfe0-9fed-4b7d-b3de-6c4309bfd6f3 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:46.271806 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-2f07dfe0-9fed-4b7d-b3de-6c4309bfd6f3 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 08b1b860-516e-4041-8df8-1fa8cc65a4ed] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:46.278834 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2f07dfe0-9fed-4b7d-b3de-6c4309bfd6f3 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:46.279416 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2f07dfe0-9fed-4b7d-b3de-6c4309bfd6f3 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:46.280334 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2f07dfe0-9fed-4b7d-b3de-6c4309bfd6f3 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:46.281016 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2f07dfe0-9fed-4b7d-b3de-6c4309bfd6f3 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:46.449191 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-5d459894-89fa-4dbf-bd62-16ce9dbdfaeb tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7575179edbda45208561c983fc5b956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20763921c37c4e81bba702e09bf628b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:46.457336 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-5d459894-89fa-4dbf-bd62-16ce9dbdfaeb tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a" status: 200 len: 1367 microversion: 2.1 time: 0.502383 May 30 12:04:46.469057 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 33/71] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:04:45 2022] GET /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a => generated 1367 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:04:46.571041 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-a31338da-7a74-4ce3-84bb-99dfe3ae6342 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:46.571899 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-a31338da-7a74-4ce3-84bb-99dfe3ae6342 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:46.578497 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a31338da-7a74-4ce3-84bb-99dfe3ae6342 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:46.581468 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a31338da-7a74-4ce3-84bb-99dfe3ae6342 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:46.582842 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a31338da-7a74-4ce3-84bb-99dfe3ae6342 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:46.583435 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a31338da-7a74-4ce3-84bb-99dfe3ae6342 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:46.750921 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-a31338da-7a74-4ce3-84bb-99dfe3ae6342 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:46.762344 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-a31338da-7a74-4ce3-84bb-99dfe3ae6342 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:46.764083 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-a31338da-7a74-4ce3-84bb-99dfe3ae6342 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:46.766299 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-a31338da-7a74-4ce3-84bb-99dfe3ae6342 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1340 microversion: 2.20 time: 0.199349 May 30 12:04:46.780406 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 34/72] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:04:46 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1340 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 30 12:04:46.821416 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-2f07dfe0-9fed-4b7d-b3de-6c4309bfd6f3 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76e8d7bfdc04ea79c83ca7fb6b9ade1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5074cf3e6248668995f266845c8969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:46.835460 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-2f07dfe0-9fed-4b7d-b3de-6c4309bfd6f3 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed" status: 200 len: 1362 microversion: 2.1 time: 0.568380 May 30 12:04:46.836451 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 39/73] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:04:46 2022] GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed => generated 1362 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:04:47.108102 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-e36e49bf-d277-42ee-b83e-2c493db00dc2 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:47.108754 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-e36e49bf-d277-42ee-b83e-2c493db00dc2 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] [instance: 5a06904b-d932-4635-90df-b69dcb15d941] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:47.126585 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e36e49bf-d277-42ee-b83e-2c493db00dc2 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:47.129018 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e36e49bf-d277-42ee-b83e-2c493db00dc2 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:47.130641 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e36e49bf-d277-42ee-b83e-2c493db00dc2 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:47.133926 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e36e49bf-d277-42ee-b83e-2c493db00dc2 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:47.275885 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-ecf9f9c3-f3a7-4adf-8847-024b45f455d9 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:47.277287 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-ecf9f9c3-f3a7-4adf-8847-024b45f455d9 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 8542b17d-0c65-4c5d-bc97-9d17545e2126] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:47.288878 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ecf9f9c3-f3a7-4adf-8847-024b45f455d9 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:47.291798 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ecf9f9c3-f3a7-4adf-8847-024b45f455d9 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:47.293113 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ecf9f9c3-f3a7-4adf-8847-024b45f455d9 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:47.293789 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ecf9f9c3-f3a7-4adf-8847-024b45f455d9 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:47.519309 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-ecf9f9c3-f3a7-4adf-8847-024b45f455d9 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:47.549604 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-ecf9f9c3-f3a7-4adf-8847-024b45f455d9 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126" status: 200 len: 1279 microversion: 2.1 time: 0.277906 May 30 12:04:47.550725 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 40/74] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:04:47 2022] GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126 => generated 1279 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:04:47.570844 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-f3f6cb68-d8da-4609-bc2f-00f67cce4e23 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:47.578091 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-f3f6cb68-d8da-4609-bc2f-00f67cce4e23 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: 54ad4de0-2282-4baf-86a4-40d5ba1ba62a] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:47.599849 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f3f6cb68-d8da-4609-bc2f-00f67cce4e23 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:47.600603 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f3f6cb68-d8da-4609-bc2f-00f67cce4e23 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:47.601705 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f3f6cb68-d8da-4609-bc2f-00f67cce4e23 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:47.602476 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f3f6cb68-d8da-4609-bc2f-00f67cce4e23 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:47.864564 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-e36e49bf-d277-42ee-b83e-2c493db00dc2 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e591526a8c3645de9c5965a40f8ef90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60b241805384ef49352b3791cfd3d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:47.875658 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-e36e49bf-d277-42ee-b83e-2c493db00dc2 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] 10.222.0.32 "GET /compute/v2.1/servers/5a06904b-d932-4635-90df-b69dcb15d941" status: 200 len: 1314 microversion: 2.1 time: 0.771261 May 30 12:04:47.878149 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 35/75] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:04:47 2022] GET /compute/v2.1/servers/5a06904b-d932-4635-90df-b69dcb15d941 => generated 1314 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:04:47.891874 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-8cb62849-2c90-4b2e-b8e5-5b85ba9f14a2 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:47.893431 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-8cb62849-2c90-4b2e-b8e5-5b85ba9f14a2 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:47.906519 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8cb62849-2c90-4b2e-b8e5-5b85ba9f14a2 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:47.909309 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8cb62849-2c90-4b2e-b8e5-5b85ba9f14a2 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:47.912870 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8cb62849-2c90-4b2e-b8e5-5b85ba9f14a2 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:47.913586 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8cb62849-2c90-4b2e-b8e5-5b85ba9f14a2 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:48.130642 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-8cb62849-2c90-4b2e-b8e5-5b85ba9f14a2 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:48.162980 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-8cb62849-2c90-4b2e-b8e5-5b85ba9f14a2 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:48.178710 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-8cb62849-2c90-4b2e-b8e5-5b85ba9f14a2 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:48.184085 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-8cb62849-2c90-4b2e-b8e5-5b85ba9f14a2 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1340 microversion: 2.20 time: 0.303890 May 30 12:04:48.189492 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 36/76] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:04:47 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1340 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:04:48.207557 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-0c221462-c9de-4daf-a910-6d448fc59a45 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:48.212450 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-0c221462-c9de-4daf-a910-6d448fc59a45 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 08b1b860-516e-4041-8df8-1fa8cc65a4ed] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:48.230930 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-0c221462-c9de-4daf-a910-6d448fc59a45 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:48.231815 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-0c221462-c9de-4daf-a910-6d448fc59a45 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:48.234104 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-0c221462-c9de-4daf-a910-6d448fc59a45 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:48.234949 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-0c221462-c9de-4daf-a910-6d448fc59a45 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:48.352742 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-f3f6cb68-d8da-4609-bc2f-00f67cce4e23 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7575179edbda45208561c983fc5b956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20763921c37c4e81bba702e09bf628b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:48.361897 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-f3f6cb68-d8da-4609-bc2f-00f67cce4e23 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a" status: 200 len: 1367 microversion: 2.1 time: 0.799069 May 30 12:04:48.362755 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 41/77] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:04:47 2022] GET /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a => generated 1367 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:04:48.569923 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-55628c86-73f4-4211-a303-839a972f3dc9 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:48.571529 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-55628c86-73f4-4211-a303-839a972f3dc9 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 8542b17d-0c65-4c5d-bc97-9d17545e2126] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:48.576177 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell0:SELECT=22 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:04:48.585506 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell0:SELECT=6 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:04:48.594583 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-55628c86-73f4-4211-a303-839a972f3dc9 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:48.596067 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-55628c86-73f4-4211-a303-839a972f3dc9 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:48.599115 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-55628c86-73f4-4211-a303-839a972f3dc9 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:48.600723 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-55628c86-73f4-4211-a303-839a972f3dc9 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:48.780732 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-0c221462-c9de-4daf-a910-6d448fc59a45 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76e8d7bfdc04ea79c83ca7fb6b9ade1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5074cf3e6248668995f266845c8969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:48.799119 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-0c221462-c9de-4daf-a910-6d448fc59a45 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed" status: 200 len: 1362 microversion: 2.1 time: 0.599802 May 30 12:04:48.800252 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 37/78] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:04:48 2022] GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed => generated 1362 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:04:48.812931 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-55628c86-73f4-4211-a303-839a972f3dc9 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:48.843811 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-53a77400-c6f1-4b52-9727-f4a5d110406f req-42e10268-1641-4f70-9b23-37ca4bc7e732 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54ad4de0-2282-4baf-86a4-40d5ba1ba62a", "tag": "f3718156-6792-4881-a093-e2245a9c75e4"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:04:48.856705 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-53a77400-c6f1-4b52-9727-f4a5d110406f req-42e10268-1641-4f70-9b23-37ca4bc7e732 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:48.857529 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-53a77400-c6f1-4b52-9727-f4a5d110406f req-42e10268-1641-4f70-9b23-37ca4bc7e732 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:48.870923 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-55628c86-73f4-4211-a303-839a972f3dc9 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126" status: 200 len: 1279 microversion: 2.1 time: 0.307269 May 30 12:04:48.880702 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 42/79] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:04:48 2022] GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126 => generated 1279 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:04:48.883795 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-53a77400-c6f1-4b52-9727-f4a5d110406f req-42e10268-1641-4f70-9b23-37ca4bc7e732 service nova] Creating event network-changed:f3718156-6792-4881-a093-e2245a9c75e4 for instance 54ad4de0-2282-4baf-86a4-40d5ba1ba62a on hv-cinder-84051 May 30 12:04:48.892693 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-53a77400-c6f1-4b52-9727-f4a5d110406f req-42e10268-1641-4f70-9b23-37ca4bc7e732 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065589 May 30 12:04:48.894046 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 38/80] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:04:48.897668 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-d645d68c-9e10-42a3-a549-d2ead60539bd tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:48.899017 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-d645d68c-9e10-42a3-a549-d2ead60539bd tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] [instance: 5a06904b-d932-4635-90df-b69dcb15d941] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:48.920013 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d645d68c-9e10-42a3-a549-d2ead60539bd tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:48.920505 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d645d68c-9e10-42a3-a549-d2ead60539bd tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:48.921282 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d645d68c-9e10-42a3-a549-d2ead60539bd tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:48.921917 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d645d68c-9e10-42a3-a549-d2ead60539bd tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:49.217030 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-b12cba2c-c648-4d2a-9ee3-a50f739957c7 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:49.220391 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-b12cba2c-c648-4d2a-9ee3-a50f739957c7 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:49.241433 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell0:SELECT=18 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:04:49.252009 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b12cba2c-c648-4d2a-9ee3-a50f739957c7 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:49.254788 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b12cba2c-c648-4d2a-9ee3-a50f739957c7 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:49.256967 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b12cba2c-c648-4d2a-9ee3-a50f739957c7 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:49.258237 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b12cba2c-c648-4d2a-9ee3-a50f739957c7 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:49.465985 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-d645d68c-9e10-42a3-a549-d2ead60539bd tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e591526a8c3645de9c5965a40f8ef90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60b241805384ef49352b3791cfd3d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:49.475048 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-d645d68c-9e10-42a3-a549-d2ead60539bd tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] 10.222.0.32 "GET /compute/v2.1/servers/5a06904b-d932-4635-90df-b69dcb15d941" status: 200 len: 1314 microversion: 2.1 time: 0.584289 May 30 12:04:49.475888 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 43/81] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:04:48 2022] GET /compute/v2.1/servers/5a06904b-d932-4635-90df-b69dcb15d941 => generated 1314 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:04:49.487928 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-29f17706-dca7-4017-b04c-2ecc7359b30e tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:49.488765 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-29f17706-dca7-4017-b04c-2ecc7359b30e tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: 54ad4de0-2282-4baf-86a4-40d5ba1ba62a] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:49.495670 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-29f17706-dca7-4017-b04c-2ecc7359b30e tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:49.496120 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-29f17706-dca7-4017-b04c-2ecc7359b30e tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:49.496944 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-29f17706-dca7-4017-b04c-2ecc7359b30e tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:49.497371 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-29f17706-dca7-4017-b04c-2ecc7359b30e tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:49.696407 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-b12cba2c-c648-4d2a-9ee3-a50f739957c7 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:49.706110 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-b12cba2c-c648-4d2a-9ee3-a50f739957c7 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:49.707651 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-b12cba2c-c648-4d2a-9ee3-a50f739957c7 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:49.708821 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-b12cba2c-c648-4d2a-9ee3-a50f739957c7 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1408 microversion: 2.20 time: 0.504776 May 30 12:04:49.709382 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 39/82] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:04:49 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1408 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:04:49.756683 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-29f17706-dca7-4017-b04c-2ecc7359b30e tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7575179edbda45208561c983fc5b956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20763921c37c4e81bba702e09bf628b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:49.765643 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-29f17706-dca7-4017-b04c-2ecc7359b30e tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a" status: 200 len: 1367 microversion: 2.1 time: 0.288558 May 30 12:04:49.766222 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 44/83] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:04:49 2022] GET /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a => generated 1367 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:04:49.817702 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-c52e4bcc-f5c9-4b77-a26d-650f4fd9e6b1 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:49.818684 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-c52e4bcc-f5c9-4b77-a26d-650f4fd9e6b1 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 08b1b860-516e-4041-8df8-1fa8cc65a4ed] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:49.826088 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c52e4bcc-f5c9-4b77-a26d-650f4fd9e6b1 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:49.826772 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c52e4bcc-f5c9-4b77-a26d-650f4fd9e6b1 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:49.827830 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c52e4bcc-f5c9-4b77-a26d-650f4fd9e6b1 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:49.828647 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c52e4bcc-f5c9-4b77-a26d-650f4fd9e6b1 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:49.893747 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-1ec8cd1d-2e88-463b-a7f2-ad34d766ea47 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:49.895817 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-1ec8cd1d-2e88-463b-a7f2-ad34d766ea47 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 8542b17d-0c65-4c5d-bc97-9d17545e2126] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:49.904450 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1ec8cd1d-2e88-463b-a7f2-ad34d766ea47 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:49.905524 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1ec8cd1d-2e88-463b-a7f2-ad34d766ea47 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:49.906870 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1ec8cd1d-2e88-463b-a7f2-ad34d766ea47 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:49.907464 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1ec8cd1d-2e88-463b-a7f2-ad34d766ea47 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:50.230834 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-c52e4bcc-f5c9-4b77-a26d-650f4fd9e6b1 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76e8d7bfdc04ea79c83ca7fb6b9ade1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5074cf3e6248668995f266845c8969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:50.243459 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-c52e4bcc-f5c9-4b77-a26d-650f4fd9e6b1 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed" status: 200 len: 1362 microversion: 2.1 time: 0.430314 May 30 12:04:50.246448 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 40/84] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:04:49 2022] GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed => generated 1362 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:04:50.283788 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-1ec8cd1d-2e88-463b-a7f2-ad34d766ea47 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:50.294053 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-1ec8cd1d-2e88-463b-a7f2-ad34d766ea47 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126" status: 200 len: 1321 microversion: 2.1 time: 0.408985 May 30 12:04:50.296325 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 45/85] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:04:49 2022] GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126 => generated 1321 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:04:50.497315 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-e4dc199d-dfa0-4369-bc9d-371fd64e98d3 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:50.499021 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-e4dc199d-dfa0-4369-bc9d-371fd64e98d3 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] [instance: 5a06904b-d932-4635-90df-b69dcb15d941] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:50.530098 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e4dc199d-dfa0-4369-bc9d-371fd64e98d3 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:50.534973 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e4dc199d-dfa0-4369-bc9d-371fd64e98d3 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:50.537206 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e4dc199d-dfa0-4369-bc9d-371fd64e98d3 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:50.538980 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e4dc199d-dfa0-4369-bc9d-371fd64e98d3 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:50.731374 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-1f72d01b-f72d-4900-99b4-b368c3586f48 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:50.732089 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-1f72d01b-f72d-4900-99b4-b368c3586f48 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:50.751569 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1f72d01b-f72d-4900-99b4-b368c3586f48 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:50.756289 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1f72d01b-f72d-4900-99b4-b368c3586f48 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:50.758060 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1f72d01b-f72d-4900-99b4-b368c3586f48 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:50.759031 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1f72d01b-f72d-4900-99b4-b368c3586f48 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:51.203831 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-e4dc199d-dfa0-4369-bc9d-371fd64e98d3 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e591526a8c3645de9c5965a40f8ef90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60b241805384ef49352b3791cfd3d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:51.218169 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-e4dc199d-dfa0-4369-bc9d-371fd64e98d3 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] 10.222.0.32 "GET /compute/v2.1/servers/5a06904b-d932-4635-90df-b69dcb15d941" status: 200 len: 1314 microversion: 2.1 time: 0.728788 May 30 12:04:51.223264 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-1f72d01b-f72d-4900-99b4-b368c3586f48 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:51.229789 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 41/86] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:04:50 2022] GET /compute/v2.1/servers/5a06904b-d932-4635-90df-b69dcb15d941 => generated 1314 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:04:51.233759 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-1f72d01b-f72d-4900-99b4-b368c3586f48 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:51.238346 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-b9dc6e7b-8164-4a79-ad91-0ea80054d86c tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:51.239959 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-b9dc6e7b-8164-4a79-ad91-0ea80054d86c tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: 54ad4de0-2282-4baf-86a4-40d5ba1ba62a] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:51.243002 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-1f72d01b-f72d-4900-99b4-b368c3586f48 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:51.244485 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-1f72d01b-f72d-4900-99b4-b368c3586f48 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1408 microversion: 2.20 time: 0.517703 May 30 12:04:51.245363 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 46/87] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:04:50 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1408 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 30 12:04:51.250158 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-f9f0f140-8e05-446b-8513-dc9d1aa6a41c req-a9910f68-a204-4ff2-8673-9aa5d7083347 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "314658c0-2ad4-4987-99bc-f8acf2d7e46c", "tag": "66de87a6-f3b1-41fb-8926-85240efcbe51"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:04:51.257983 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b9dc6e7b-8164-4a79-ad91-0ea80054d86c tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:51.258666 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b9dc6e7b-8164-4a79-ad91-0ea80054d86c tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:51.259847 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b9dc6e7b-8164-4a79-ad91-0ea80054d86c tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:51.260722 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b9dc6e7b-8164-4a79-ad91-0ea80054d86c tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:51.263171 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-f9f0f140-8e05-446b-8513-dc9d1aa6a41c req-a9910f68-a204-4ff2-8673-9aa5d7083347 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:51.263623 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-f9f0f140-8e05-446b-8513-dc9d1aa6a41c req-a9910f68-a204-4ff2-8673-9aa5d7083347 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:51.289497 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-f9f0f140-8e05-446b-8513-dc9d1aa6a41c req-a9910f68-a204-4ff2-8673-9aa5d7083347 service nova] Creating event network-changed:66de87a6-f3b1-41fb-8926-85240efcbe51 for instance 314658c0-2ad4-4987-99bc-f8acf2d7e46c on hv-cinder-84051 May 30 12:04:51.300279 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-f9f0f140-8e05-446b-8513-dc9d1aa6a41c req-a9910f68-a204-4ff2-8673-9aa5d7083347 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053505 May 30 12:04:51.302312 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 47/88] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:04:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:04:51.613310 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-88cd0e25-dfc0-4b72-be8a-0777e0e059d7 req-d96fa0de-3711-4f00-b53c-0a247f10decc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a06904b-d932-4635-90df-b69dcb15d941", "name": "network-vif-plugged", "status": "completed", "tag": "4fecff73-c0eb-4774-9017-6b7fd73b4455"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:04:51.632987 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-88cd0e25-dfc0-4b72-be8a-0777e0e059d7 req-d96fa0de-3711-4f00-b53c-0a247f10decc service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:51.633554 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-88cd0e25-dfc0-4b72-be8a-0777e0e059d7 req-d96fa0de-3711-4f00-b53c-0a247f10decc service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:51.652960 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-88cd0e25-dfc0-4b72-be8a-0777e0e059d7 req-d96fa0de-3711-4f00-b53c-0a247f10decc service nova] Creating event network-vif-plugged:4fecff73-c0eb-4774-9017-6b7fd73b4455 for instance 5a06904b-d932-4635-90df-b69dcb15d941 on hv-cinder-84051 May 30 12:04:51.663011 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-88cd0e25-dfc0-4b72-be8a-0777e0e059d7 req-d96fa0de-3711-4f00-b53c-0a247f10decc service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.359231 May 30 12:04:51.663956 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 48/89] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:04:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:04:51.670652 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-4362cbaf-560f-4dde-8b7c-aed400c54056 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:51.671470 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-4362cbaf-560f-4dde-8b7c-aed400c54056 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 08b1b860-516e-4041-8df8-1fa8cc65a4ed] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:51.674711 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-b9dc6e7b-8164-4a79-ad91-0ea80054d86c tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7575179edbda45208561c983fc5b956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20763921c37c4e81bba702e09bf628b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:51.683760 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4362cbaf-560f-4dde-8b7c-aed400c54056 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:51.684368 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4362cbaf-560f-4dde-8b7c-aed400c54056 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:51.685222 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4362cbaf-560f-4dde-8b7c-aed400c54056 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:51.685665 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4362cbaf-560f-4dde-8b7c-aed400c54056 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:51.694874 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-b9dc6e7b-8164-4a79-ad91-0ea80054d86c tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a" status: 200 len: 1367 microversion: 2.1 time: 0.462340 May 30 12:04:51.698028 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 42/90] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:04:51 2022] GET /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a => generated 1367 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:04:51.730026 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-f0b66152-656d-429f-aee3-cfd254a83be5 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:51.730852 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-f0b66152-656d-429f-aee3-cfd254a83be5 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 8542b17d-0c65-4c5d-bc97-9d17545e2126] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:51.748232 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f0b66152-656d-429f-aee3-cfd254a83be5 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:51.748689 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f0b66152-656d-429f-aee3-cfd254a83be5 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:51.753475 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f0b66152-656d-429f-aee3-cfd254a83be5 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:51.753939 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f0b66152-656d-429f-aee3-cfd254a83be5 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:52.110134 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-4362cbaf-560f-4dde-8b7c-aed400c54056 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76e8d7bfdc04ea79c83ca7fb6b9ade1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5074cf3e6248668995f266845c8969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:52.137217 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-4362cbaf-560f-4dde-8b7c-aed400c54056 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed" status: 200 len: 1362 microversion: 2.1 time: 0.457047 May 30 12:04:52.138692 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 49/91] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:04:51 2022] GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed => generated 1362 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:04:52.145363 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-9fae1f7b-55c2-4ebb-adc6-efd4c1f3643b req-5c2c4e08-9adc-4222-989e-61ad888c9c5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8542b17d-0c65-4c5d-bc97-9d17545e2126", "tag": "1f1b1022-04af-4f21-b1e6-4960bf03a94c"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:04:52.158162 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-9fae1f7b-55c2-4ebb-adc6-efd4c1f3643b req-5c2c4e08-9adc-4222-989e-61ad888c9c5a service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:52.159334 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-9fae1f7b-55c2-4ebb-adc6-efd4c1f3643b req-5c2c4e08-9adc-4222-989e-61ad888c9c5a service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:52.179226 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-f0b66152-656d-429f-aee3-cfd254a83be5 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:52.197927 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-f0b66152-656d-429f-aee3-cfd254a83be5 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126" status: 200 len: 1321 microversion: 2.1 time: 0.488058 May 30 12:04:52.208948 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 43/92] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:04:51 2022] GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126 => generated 1321 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:04:52.209237 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-9fae1f7b-55c2-4ebb-adc6-efd4c1f3643b req-5c2c4e08-9adc-4222-989e-61ad888c9c5a service nova] Creating event network-changed:1f1b1022-04af-4f21-b1e6-4960bf03a94c for instance 8542b17d-0c65-4c5d-bc97-9d17545e2126 on hv-cinder-84051 May 30 12:04:52.221997 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-9fae1f7b-55c2-4ebb-adc6-efd4c1f3643b req-5c2c4e08-9adc-4222-989e-61ad888c9c5a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081662 May 30 12:04:52.222728 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 50/93] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:04:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:04:52.236050 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-ad867d94-1177-497b-a45d-1e62b4f3c72e tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:52.237001 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-ad867d94-1177-497b-a45d-1e62b4f3c72e tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] [instance: 5a06904b-d932-4635-90df-b69dcb15d941] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:52.239271 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:04:52.245337 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ad867d94-1177-497b-a45d-1e62b4f3c72e tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:52.246048 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ad867d94-1177-497b-a45d-1e62b4f3c72e tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:52.247054 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ad867d94-1177-497b-a45d-1e62b4f3c72e tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:52.247567 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ad867d94-1177-497b-a45d-1e62b4f3c72e tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:52.265177 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-13dacc50-a3a1-4b6a-b953-5aa7d586c2f4 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:52.266142 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-13dacc50-a3a1-4b6a-b953-5aa7d586c2f4 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:52.281047 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:04:52.283494 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-13dacc50-a3a1-4b6a-b953-5aa7d586c2f4 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:52.284054 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-13dacc50-a3a1-4b6a-b953-5aa7d586c2f4 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:52.288485 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-13dacc50-a3a1-4b6a-b953-5aa7d586c2f4 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:52.289378 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-13dacc50-a3a1-4b6a-b953-5aa7d586c2f4 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:52.587799 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-13dacc50-a3a1-4b6a-b953-5aa7d586c2f4 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:52.601520 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-ad867d94-1177-497b-a45d-1e62b4f3c72e tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e591526a8c3645de9c5965a40f8ef90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60b241805384ef49352b3791cfd3d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:52.611971 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-ad867d94-1177-497b-a45d-1e62b4f3c72e tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] 10.222.0.32 "GET /compute/v2.1/servers/5a06904b-d932-4635-90df-b69dcb15d941" status: 200 len: 1314 microversion: 2.1 time: 0.380136 May 30 12:04:52.614198 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-13dacc50-a3a1-4b6a-b953-5aa7d586c2f4 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:52.615822 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-13dacc50-a3a1-4b6a-b953-5aa7d586c2f4 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:52.617439 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 44/94] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:04:52 2022] GET /compute/v2.1/servers/5a06904b-d932-4635-90df-b69dcb15d941 => generated 1314 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:04:52.618868 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-13dacc50-a3a1-4b6a-b953-5aa7d586c2f4 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1408 microversion: 2.20 time: 0.359613 May 30 12:04:52.620214 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 51/95] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:04:52 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1408 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 30 12:04:52.716791 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-611beb99-6ad2-4a80-8120-cea80037e436 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:52.717837 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-611beb99-6ad2-4a80-8120-cea80037e436 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: 54ad4de0-2282-4baf-86a4-40d5ba1ba62a] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:52.743484 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-611beb99-6ad2-4a80-8120-cea80037e436 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:52.744042 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-611beb99-6ad2-4a80-8120-cea80037e436 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:52.744970 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-611beb99-6ad2-4a80-8120-cea80037e436 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:52.745484 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-611beb99-6ad2-4a80-8120-cea80037e436 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:53.000783 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-611beb99-6ad2-4a80-8120-cea80037e436 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7575179edbda45208561c983fc5b956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20763921c37c4e81bba702e09bf628b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:53.009457 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-611beb99-6ad2-4a80-8120-cea80037e436 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a" status: 200 len: 1367 microversion: 2.1 time: 0.298094 May 30 12:04:53.012652 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 45/96] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:04:52 2022] GET /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a => generated 1367 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:04:53.160651 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-a6632979-65dc-4697-b12d-bc4a854d5921 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:53.163249 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-a6632979-65dc-4697-b12d-bc4a854d5921 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 08b1b860-516e-4041-8df8-1fa8cc65a4ed] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:53.171834 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a6632979-65dc-4697-b12d-bc4a854d5921 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:53.173674 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a6632979-65dc-4697-b12d-bc4a854d5921 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:53.175872 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a6632979-65dc-4697-b12d-bc4a854d5921 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:53.176580 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a6632979-65dc-4697-b12d-bc4a854d5921 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:53.214694 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-90a84b86-7694-425d-b07b-458508696f00 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:53.215834 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-90a84b86-7694-425d-b07b-458508696f00 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 8542b17d-0c65-4c5d-bc97-9d17545e2126] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:53.227865 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-90a84b86-7694-425d-b07b-458508696f00 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:53.228628 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-90a84b86-7694-425d-b07b-458508696f00 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:53.229424 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-90a84b86-7694-425d-b07b-458508696f00 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:53.233016 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-90a84b86-7694-425d-b07b-458508696f00 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:53.524116 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-90a84b86-7694-425d-b07b-458508696f00 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:53.529442 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-a6632979-65dc-4697-b12d-bc4a854d5921 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76e8d7bfdc04ea79c83ca7fb6b9ade1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5074cf3e6248668995f266845c8969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:53.533943 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-90a84b86-7694-425d-b07b-458508696f00 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126" status: 200 len: 1321 microversion: 2.1 time: 0.322955 May 30 12:04:53.535583 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 46/97] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:04:53 2022] GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126 => generated 1321 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:04:53.538451 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-a6632979-65dc-4697-b12d-bc4a854d5921 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed" status: 200 len: 1362 microversion: 2.1 time: 0.382553 May 30 12:04:53.549179 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 52/98] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:04:53 2022] GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed => generated 1362 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:04:53.635363 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-a27d0d0d-6a62-4e20-9986-ea019a9aec78 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:53.635982 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-a27d0d0d-6a62-4e20-9986-ea019a9aec78 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] [instance: 5a06904b-d932-4635-90df-b69dcb15d941] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:53.644382 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a27d0d0d-6a62-4e20-9986-ea019a9aec78 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:53.645439 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-68c235d4-81d5-4cdf-8e27-8a6fed1e7c6e tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:53.645837 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a27d0d0d-6a62-4e20-9986-ea019a9aec78 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:53.646478 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-68c235d4-81d5-4cdf-8e27-8a6fed1e7c6e tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:53.647449 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a27d0d0d-6a62-4e20-9986-ea019a9aec78 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:53.649524 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a27d0d0d-6a62-4e20-9986-ea019a9aec78 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:53.655805 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-68c235d4-81d5-4cdf-8e27-8a6fed1e7c6e tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:53.656283 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-68c235d4-81d5-4cdf-8e27-8a6fed1e7c6e tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:53.657601 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-68c235d4-81d5-4cdf-8e27-8a6fed1e7c6e tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:53.658199 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-68c235d4-81d5-4cdf-8e27-8a6fed1e7c6e tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:53.917390 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-a27d0d0d-6a62-4e20-9986-ea019a9aec78 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e591526a8c3645de9c5965a40f8ef90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60b241805384ef49352b3791cfd3d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:53.934040 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-a27d0d0d-6a62-4e20-9986-ea019a9aec78 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] 10.222.0.32 "GET /compute/v2.1/servers/5a06904b-d932-4635-90df-b69dcb15d941" status: 200 len: 1314 microversion: 2.1 time: 0.302157 May 30 12:04:53.935189 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 47/99] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:04:53 2022] GET /compute/v2.1/servers/5a06904b-d932-4635-90df-b69dcb15d941 => generated 1314 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:04:53.962214 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-68c235d4-81d5-4cdf-8e27-8a6fed1e7c6e tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:53.974048 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-68c235d4-81d5-4cdf-8e27-8a6fed1e7c6e tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:53.975650 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-68c235d4-81d5-4cdf-8e27-8a6fed1e7c6e tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:53.977010 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-68c235d4-81d5-4cdf-8e27-8a6fed1e7c6e tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1408 microversion: 2.20 time: 0.343202 May 30 12:04:53.989145 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 53/100] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:04:53 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1408 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:04:54.034144 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-52093b4c-7a9e-483b-8d07-c3262ba95214 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:54.034980 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-52093b4c-7a9e-483b-8d07-c3262ba95214 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: 54ad4de0-2282-4baf-86a4-40d5ba1ba62a] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:54.043742 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-52093b4c-7a9e-483b-8d07-c3262ba95214 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:54.044345 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-52093b4c-7a9e-483b-8d07-c3262ba95214 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:54.045134 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-52093b4c-7a9e-483b-8d07-c3262ba95214 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:54.045671 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-52093b4c-7a9e-483b-8d07-c3262ba95214 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:54.293173 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-52093b4c-7a9e-483b-8d07-c3262ba95214 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7575179edbda45208561c983fc5b956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20763921c37c4e81bba702e09bf628b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:54.307719 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-52093b4c-7a9e-483b-8d07-c3262ba95214 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a" status: 200 len: 1367 microversion: 2.1 time: 0.276514 May 30 12:04:54.317917 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 48/101] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:04:54 2022] GET /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a => generated 1367 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:04:54.524388 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-ca1e39c2-b40b-4a8b-9601-88adb180ed71 req-c51e637f-8695-423d-80a7-2a6390d90511 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcdae5e3-81e8-412d-9e2a-0a481c13b57b", "name": "network-vif-plugged", "status": "completed", "tag": "4002c1fa-42e8-4916-ae13-112447234689"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:04:54.541217 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-ca1e39c2-b40b-4a8b-9601-88adb180ed71 req-c51e637f-8695-423d-80a7-2a6390d90511 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:54.547035 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-ca1e39c2-b40b-4a8b-9601-88adb180ed71 req-c51e637f-8695-423d-80a7-2a6390d90511 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:54.553999 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell1:SELECT=100 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:04:54.554578 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-8a9e283f-b949-4fbb-8b1d-8a5d133ae6dc tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:54.555871 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-8a9e283f-b949-4fbb-8b1d-8a5d133ae6dc tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 8542b17d-0c65-4c5d-bc97-9d17545e2126] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:54.575745 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-ca1e39c2-b40b-4a8b-9601-88adb180ed71 req-c51e637f-8695-423d-80a7-2a6390d90511 service nova] Creating event network-vif-plugged:4002c1fa-42e8-4916-ae13-112447234689 for instance dcdae5e3-81e8-412d-9e2a-0a481c13b57b on hv-cinder-84051 May 30 12:04:54.584891 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8a9e283f-b949-4fbb-8b1d-8a5d133ae6dc tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:54.587791 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8a9e283f-b949-4fbb-8b1d-8a5d133ae6dc tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:54.591537 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-ca1e39c2-b40b-4a8b-9601-88adb180ed71 req-c51e637f-8695-423d-80a7-2a6390d90511 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071425 May 30 12:04:54.597867 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 54/102] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:04:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:04:54.598492 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8a9e283f-b949-4fbb-8b1d-8a5d133ae6dc tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:54.599034 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8a9e283f-b949-4fbb-8b1d-8a5d133ae6dc tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:54.607754 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-c9d819a8-4204-4e7d-9a24-1d641db0092a tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:54.619833 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-c9d819a8-4204-4e7d-9a24-1d641db0092a tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 08b1b860-516e-4041-8df8-1fa8cc65a4ed] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:54.650440 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c9d819a8-4204-4e7d-9a24-1d641db0092a tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:54.650907 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c9d819a8-4204-4e7d-9a24-1d641db0092a tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:54.651701 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c9d819a8-4204-4e7d-9a24-1d641db0092a tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:54.652142 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c9d819a8-4204-4e7d-9a24-1d641db0092a tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:55.036697 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell0:SELECT=6 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:04:55.064098 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-8a9e283f-b949-4fbb-8b1d-8a5d133ae6dc tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:55.073572 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-8a9e283f-b949-4fbb-8b1d-8a5d133ae6dc tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126" status: 200 len: 1321 microversion: 2.1 time: 0.524234 May 30 12:04:55.076047 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 49/103] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:04:54 2022] GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126 => generated 1321 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:04:55.082702 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-11bdefb2-7251-4cef-83d9-5c5157d82843 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:55.083609 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-11bdefb2-7251-4cef-83d9-5c5157d82843 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] [instance: 5a06904b-d932-4635-90df-b69dcb15d941] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:55.095801 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-c9d819a8-4204-4e7d-9a24-1d641db0092a tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76e8d7bfdc04ea79c83ca7fb6b9ade1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5074cf3e6248668995f266845c8969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:55.105384 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-c9d819a8-4204-4e7d-9a24-1d641db0092a tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed" status: 200 len: 1362 microversion: 2.1 time: 0.508224 May 30 12:04:55.106133 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 55/104] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:04:54 2022] GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed => generated 1362 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:04:55.106278 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-11bdefb2-7251-4cef-83d9-5c5157d82843 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:55.108922 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-11bdefb2-7251-4cef-83d9-5c5157d82843 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:55.109774 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-11bdefb2-7251-4cef-83d9-5c5157d82843 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:55.112569 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-b7a1775c-003e-40eb-90d1-0b6f7b0b2480 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:55.113810 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-b7a1775c-003e-40eb-90d1-0b6f7b0b2480 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:55.116996 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-11bdefb2-7251-4cef-83d9-5c5157d82843 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:55.120441 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b7a1775c-003e-40eb-90d1-0b6f7b0b2480 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:55.121235 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b7a1775c-003e-40eb-90d1-0b6f7b0b2480 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:55.121537 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell1:SELECT=100 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:04:55.122437 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b7a1775c-003e-40eb-90d1-0b6f7b0b2480 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:55.123080 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b7a1775c-003e-40eb-90d1-0b6f7b0b2480 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:55.333102 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-11bdefb2-7251-4cef-83d9-5c5157d82843 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e591526a8c3645de9c5965a40f8ef90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60b241805384ef49352b3791cfd3d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:55.342505 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-11bdefb2-7251-4cef-83d9-5c5157d82843 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] 10.222.0.32 "GET /compute/v2.1/servers/5a06904b-d932-4635-90df-b69dcb15d941" status: 200 len: 1314 microversion: 2.1 time: 0.263566 May 30 12:04:55.344574 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 50/105] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:04:55 2022] GET /compute/v2.1/servers/5a06904b-d932-4635-90df-b69dcb15d941 => generated 1314 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:04:55.350113 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-9a55470a-d45e-4c1d-b7a7-f5bb3c04eec7 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:55.351532 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-9a55470a-d45e-4c1d-b7a7-f5bb3c04eec7 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: 54ad4de0-2282-4baf-86a4-40d5ba1ba62a] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:55.358508 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9a55470a-d45e-4c1d-b7a7-f5bb3c04eec7 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:55.359058 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9a55470a-d45e-4c1d-b7a7-f5bb3c04eec7 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:55.359892 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9a55470a-d45e-4c1d-b7a7-f5bb3c04eec7 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:55.360943 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9a55470a-d45e-4c1d-b7a7-f5bb3c04eec7 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:55.556860 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-b7a1775c-003e-40eb-90d1-0b6f7b0b2480 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:55.573693 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-b7a1775c-003e-40eb-90d1-0b6f7b0b2480 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:55.576469 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-b7a1775c-003e-40eb-90d1-0b6f7b0b2480 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:55.577858 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-b7a1775c-003e-40eb-90d1-0b6f7b0b2480 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1408 microversion: 2.20 time: 0.470412 May 30 12:04:55.582484 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-9a55470a-d45e-4c1d-b7a7-f5bb3c04eec7 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7575179edbda45208561c983fc5b956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20763921c37c4e81bba702e09bf628b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:55.585007 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 56/106] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:04:55 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1408 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:04:55.596425 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-9a55470a-d45e-4c1d-b7a7-f5bb3c04eec7 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a" status: 200 len: 1367 microversion: 2.1 time: 0.250222 May 30 12:04:55.597653 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 51/107] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:04:55 2022] GET /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a => generated 1367 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:04:56.095839 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-de78af6c-15d6-4843-9db2-666c1eac0f02 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:56.096960 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-de78af6c-15d6-4843-9db2-666c1eac0f02 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 8542b17d-0c65-4c5d-bc97-9d17545e2126] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:56.107799 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-de78af6c-15d6-4843-9db2-666c1eac0f02 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:56.109637 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-de78af6c-15d6-4843-9db2-666c1eac0f02 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:56.112785 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-de78af6c-15d6-4843-9db2-666c1eac0f02 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:56.114325 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-de78af6c-15d6-4843-9db2-666c1eac0f02 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:56.122884 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-a912bffd-4c38-404f-af28-fc5f9489ddc8 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:56.123830 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-a912bffd-4c38-404f-af28-fc5f9489ddc8 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 08b1b860-516e-4041-8df8-1fa8cc65a4ed] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:56.131826 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a912bffd-4c38-404f-af28-fc5f9489ddc8 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:56.139207 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a912bffd-4c38-404f-af28-fc5f9489ddc8 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:56.145684 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a912bffd-4c38-404f-af28-fc5f9489ddc8 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:56.146471 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a912bffd-4c38-404f-af28-fc5f9489ddc8 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:56.428670 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-de78af6c-15d6-4843-9db2-666c1eac0f02 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:56.444251 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-de78af6c-15d6-4843-9db2-666c1eac0f02 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126" status: 200 len: 1321 microversion: 2.1 time: 0.350960 May 30 12:04:56.445196 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 57/108] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:04:56 2022] GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126 => generated 1321 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:04:56.460266 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-76e65863-7e1e-41d2-9888-87d391616655 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:56.463042 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-76e65863-7e1e-41d2-9888-87d391616655 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] [instance: 5a06904b-d932-4635-90df-b69dcb15d941] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:56.473061 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-76e65863-7e1e-41d2-9888-87d391616655 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:56.473776 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-76e65863-7e1e-41d2-9888-87d391616655 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:56.475248 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-76e65863-7e1e-41d2-9888-87d391616655 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:56.476024 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-76e65863-7e1e-41d2-9888-87d391616655 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:56.506334 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-a912bffd-4c38-404f-af28-fc5f9489ddc8 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76e8d7bfdc04ea79c83ca7fb6b9ade1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5074cf3e6248668995f266845c8969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:56.517014 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-a912bffd-4c38-404f-af28-fc5f9489ddc8 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed" status: 200 len: 1362 microversion: 2.1 time: 0.397501 May 30 12:04:56.531377 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 52/109] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:04:56 2022] GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed => generated 1362 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:04:56.605637 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-05286712-e90d-4028-b271-d27c228770fd tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:56.606187 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-05286712-e90d-4028-b271-d27c228770fd tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:56.617111 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-05286712-e90d-4028-b271-d27c228770fd tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:56.618262 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-05286712-e90d-4028-b271-d27c228770fd tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:56.619991 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-05286712-e90d-4028-b271-d27c228770fd tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:56.620577 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-05286712-e90d-4028-b271-d27c228770fd tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:56.728549 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-76e65863-7e1e-41d2-9888-87d391616655 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e591526a8c3645de9c5965a40f8ef90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60b241805384ef49352b3791cfd3d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:56.743569 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-76e65863-7e1e-41d2-9888-87d391616655 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] 10.222.0.32 "GET /compute/v2.1/servers/5a06904b-d932-4635-90df-b69dcb15d941" status: 200 len: 1501 microversion: 2.1 time: 0.295567 May 30 12:04:56.757133 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 58/110] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:04:56 2022] GET /compute/v2.1/servers/5a06904b-d932-4635-90df-b69dcb15d941 => generated 1501 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:04:56.763062 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-c8978859-191e-45dc-bfb0-e0e222c77738 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:56.764332 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-c8978859-191e-45dc-bfb0-e0e222c77738 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: 54ad4de0-2282-4baf-86a4-40d5ba1ba62a] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:56.773525 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c8978859-191e-45dc-bfb0-e0e222c77738 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:56.775754 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c8978859-191e-45dc-bfb0-e0e222c77738 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:56.784428 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c8978859-191e-45dc-bfb0-e0e222c77738 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:56.785195 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c8978859-191e-45dc-bfb0-e0e222c77738 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:56.875649 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-05286712-e90d-4028-b271-d27c228770fd tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:56.889526 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-05286712-e90d-4028-b271-d27c228770fd tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:56.896812 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-05286712-e90d-4028-b271-d27c228770fd tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:56.898841 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-05286712-e90d-4028-b271-d27c228770fd tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1408 microversion: 2.20 time: 0.298926 May 30 12:04:56.899594 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 53/111] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:04:56 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1408 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:04:56.923657 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-89cb9a6e-3ed4-49d2-bb91-d85079577ac3 req-2dc23753-6601-4c0a-9032-887d40282aee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08b1b860-516e-4041-8df8-1fa8cc65a4ed", "name": "network-vif-plugged", "status": "completed", "tag": "2d71add9-9fe3-4c66-b490-513b1ce61d40"}, {"server_uuid": "314658c0-2ad4-4987-99bc-f8acf2d7e46c", "name": "network-vif-plugged", "status": "completed", "tag": "66de87a6-f3b1-41fb-8926-85240efcbe51"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:04:56.935378 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-89cb9a6e-3ed4-49d2-bb91-d85079577ac3 req-2dc23753-6601-4c0a-9032-887d40282aee service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:56.936674 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-89cb9a6e-3ed4-49d2-bb91-d85079577ac3 req-2dc23753-6601-4c0a-9032-887d40282aee service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:56.953826 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-89cb9a6e-3ed4-49d2-bb91-d85079577ac3 req-2dc23753-6601-4c0a-9032-887d40282aee service nova] Creating event network-vif-plugged:2d71add9-9fe3-4c66-b490-513b1ce61d40 for instance 08b1b860-516e-4041-8df8-1fa8cc65a4ed on hv-cinder-84051 May 30 12:04:56.954716 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-89cb9a6e-3ed4-49d2-bb91-d85079577ac3 req-2dc23753-6601-4c0a-9032-887d40282aee service nova] Creating event network-vif-plugged:66de87a6-f3b1-41fb-8926-85240efcbe51 for instance 314658c0-2ad4-4987-99bc-f8acf2d7e46c on hv-cinder-84051 May 30 12:04:56.962263 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-89cb9a6e-3ed4-49d2-bb91-d85079577ac3 req-2dc23753-6601-4c0a-9032-887d40282aee service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.061254 May 30 12:04:56.966670 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 54/112] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:04:56 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:04:57.002429 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-c8978859-191e-45dc-bfb0-e0e222c77738 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7575179edbda45208561c983fc5b956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20763921c37c4e81bba702e09bf628b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:57.010395 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-c8978859-191e-45dc-bfb0-e0e222c77738 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a" status: 200 len: 1367 microversion: 2.1 time: 0.251624 May 30 12:04:57.010990 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 59/113] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:04:56 2022] GET /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a => generated 1367 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:04:57.462824 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-4482c295-906d-4975-92bf-74a8abfc05bf tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:57.463535 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-4482c295-906d-4975-92bf-74a8abfc05bf tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 8542b17d-0c65-4c5d-bc97-9d17545e2126] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:57.475685 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4482c295-906d-4975-92bf-74a8abfc05bf tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:57.476994 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4482c295-906d-4975-92bf-74a8abfc05bf tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:57.478064 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4482c295-906d-4975-92bf-74a8abfc05bf tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:57.479532 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4482c295-906d-4975-92bf-74a8abfc05bf tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:57.535835 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-caec454a-1dc0-4caf-9c07-e60074ab9f69 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:57.536862 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-caec454a-1dc0-4caf-9c07-e60074ab9f69 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 08b1b860-516e-4041-8df8-1fa8cc65a4ed] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:57.548959 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-caec454a-1dc0-4caf-9c07-e60074ab9f69 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:57.549890 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-caec454a-1dc0-4caf-9c07-e60074ab9f69 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:57.550951 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-caec454a-1dc0-4caf-9c07-e60074ab9f69 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:57.551596 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-caec454a-1dc0-4caf-9c07-e60074ab9f69 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:57.762820 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-4482c295-906d-4975-92bf-74a8abfc05bf tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:57.776145 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-4482c295-906d-4975-92bf-74a8abfc05bf tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126" status: 200 len: 1321 microversion: 2.1 time: 0.317922 May 30 12:04:57.786760 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 55/114] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:04:57 2022] GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126 => generated 1321 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:04:57.829543 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-caec454a-1dc0-4caf-9c07-e60074ab9f69 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76e8d7bfdc04ea79c83ca7fb6b9ade1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5074cf3e6248668995f266845c8969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:57.858285 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-caec454a-1dc0-4caf-9c07-e60074ab9f69 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed" status: 200 len: 1362 microversion: 2.1 time: 0.320298 May 30 12:04:57.858932 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 60/115] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:04:57 2022] GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed => generated 1362 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:04:57.925840 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-77a0a5ce-290f-4395-a28c-71b7d2f66be8 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:57.926574 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-77a0a5ce-290f-4395-a28c-71b7d2f66be8 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:57.933959 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-77a0a5ce-290f-4395-a28c-71b7d2f66be8 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:57.934559 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-77a0a5ce-290f-4395-a28c-71b7d2f66be8 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:57.935598 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-77a0a5ce-290f-4395-a28c-71b7d2f66be8 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:57.935893 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-77a0a5ce-290f-4395-a28c-71b7d2f66be8 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:58.030793 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-06c2290d-8641-4c9a-a5d3-5bfc999808ce tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:58.031599 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-06c2290d-8641-4c9a-a5d3-5bfc999808ce tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: 54ad4de0-2282-4baf-86a4-40d5ba1ba62a] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:58.038154 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-06c2290d-8641-4c9a-a5d3-5bfc999808ce tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:58.038607 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-06c2290d-8641-4c9a-a5d3-5bfc999808ce tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:58.039381 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-06c2290d-8641-4c9a-a5d3-5bfc999808ce tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:58.039821 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-06c2290d-8641-4c9a-a5d3-5bfc999808ce tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:58.164689 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-77a0a5ce-290f-4395-a28c-71b7d2f66be8 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:58.179541 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-77a0a5ce-290f-4395-a28c-71b7d2f66be8 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:58.181143 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-77a0a5ce-290f-4395-a28c-71b7d2f66be8 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:58.182283 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-77a0a5ce-290f-4395-a28c-71b7d2f66be8 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1408 microversion: 2.20 time: 0.262044 May 30 12:04:58.182846 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 56/116] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:04:57 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1408 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:04:58.299506 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-06c2290d-8641-4c9a-a5d3-5bfc999808ce tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7575179edbda45208561c983fc5b956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20763921c37c4e81bba702e09bf628b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:58.324575 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-06c2290d-8641-4c9a-a5d3-5bfc999808ce tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a" status: 200 len: 1367 microversion: 2.1 time: 0.295569 May 30 12:04:58.327411 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 61/117] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:04:58 2022] GET /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a => generated 1367 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:04:58.357808 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-aa6958b0-4a54-4807-8a7d-1b9e2d3d81af tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "37d923bb-1b9c-42ed-a2fc-83b7854d0082"}} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:04:58.359166 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-aa6958b0-4a54-4807-8a7d-1b9e2d3d81af tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] [instance: 5a06904b-d932-4635-90df-b69dcb15d941] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:58.366365 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-aa6958b0-4a54-4807-8a7d-1b9e2d3d81af tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:58.366812 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-aa6958b0-4a54-4807-8a7d-1b9e2d3d81af tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:58.367765 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-aa6958b0-4a54-4807-8a7d-1b9e2d3d81af tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:58.368395 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-aa6958b0-4a54-4807-8a7d-1b9e2d3d81af tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:58.794194 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-9e4896a1-1140-4651-b4b5-3b24792f4b95 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:58.794801 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-9e4896a1-1140-4651-b4b5-3b24792f4b95 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 8542b17d-0c65-4c5d-bc97-9d17545e2126] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:58.804540 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9e4896a1-1140-4651-b4b5-3b24792f4b95 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:58.805088 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9e4896a1-1140-4651-b4b5-3b24792f4b95 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:58.805949 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9e4896a1-1140-4651-b4b5-3b24792f4b95 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:58.806479 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9e4896a1-1140-4651-b4b5-3b24792f4b95 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:58.957434 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-9e4896a1-1140-4651-b4b5-3b24792f4b95 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:58.992196 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-9e4896a1-1140-4651-b4b5-3b24792f4b95 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126" status: 200 len: 1321 microversion: 2.1 time: 0.201234 May 30 12:04:59.004817 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 62/118] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:04:58 2022] GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126 => generated 1321 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:04:59.010519 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-743cef46-2f10-4454-8415-a9900da6c144 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:59.011127 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-743cef46-2f10-4454-8415-a9900da6c144 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 08b1b860-516e-4041-8df8-1fa8cc65a4ed] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:59.024554 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-743cef46-2f10-4454-8415-a9900da6c144 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:59.025008 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-743cef46-2f10-4454-8415-a9900da6c144 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:59.025877 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-743cef46-2f10-4454-8415-a9900da6c144 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:59.026210 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-743cef46-2f10-4454-8415-a9900da6c144 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:59.219884 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-743cef46-2f10-4454-8415-a9900da6c144 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76e8d7bfdc04ea79c83ca7fb6b9ade1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5074cf3e6248668995f266845c8969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:59.241444 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-743cef46-2f10-4454-8415-a9900da6c144 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed" status: 200 len: 1362 microversion: 2.1 time: 0.234569 May 30 12:04:59.243867 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 63/119] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:04:59 2022] GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed => generated 1362 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:04:59.249071 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-02e32c58-9de5-497a-be13-955d4e2b4cec req-94a58a6c-0092-43dd-827c-9f0c0fb744da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54ad4de0-2282-4baf-86a4-40d5ba1ba62a", "name": "network-vif-plugged", "status": "completed", "tag": "f3718156-6792-4881-a093-e2245a9c75e4"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:04:59.261489 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-02e32c58-9de5-497a-be13-955d4e2b4cec req-94a58a6c-0092-43dd-827c-9f0c0fb744da service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:59.261984 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-02e32c58-9de5-497a-be13-955d4e2b4cec req-94a58a6c-0092-43dd-827c-9f0c0fb744da service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:59.274399 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-02e32c58-9de5-497a-be13-955d4e2b4cec req-94a58a6c-0092-43dd-827c-9f0c0fb744da service nova] Creating event network-vif-plugged:f3718156-6792-4881-a093-e2245a9c75e4 for instance 54ad4de0-2282-4baf-86a4-40d5ba1ba62a on hv-cinder-84051 May 30 12:04:59.279706 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-02e32c58-9de5-497a-be13-955d4e2b4cec req-94a58a6c-0092-43dd-827c-9f0c0fb744da service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034437 May 30 12:04:59.280333 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 64/120] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:04:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:04:59.286231 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-720f5694-69bd-4712-972b-252f445c2633 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:59.286934 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-720f5694-69bd-4712-972b-252f445c2633 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:59.293113 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-720f5694-69bd-4712-972b-252f445c2633 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:59.293562 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-720f5694-69bd-4712-972b-252f445c2633 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:59.294530 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-720f5694-69bd-4712-972b-252f445c2633 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:59.294973 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-720f5694-69bd-4712-972b-252f445c2633 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:59.468038 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-720f5694-69bd-4712-972b-252f445c2633 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:59.478210 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-720f5694-69bd-4712-972b-252f445c2633 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:59.479688 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-720f5694-69bd-4712-972b-252f445c2633 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:59.480900 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-720f5694-69bd-4712-972b-252f445c2633 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1408 microversion: 2.20 time: 0.199414 May 30 12:04:59.481438 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 65/121] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:04:59 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1408 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:04:59.486746 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-75f8c2d1-f715-4391-8509-3cf0483438de tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:59.487362 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-75f8c2d1-f715-4391-8509-3cf0483438de tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: 54ad4de0-2282-4baf-86a4-40d5ba1ba62a] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:04:59.496933 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-75f8c2d1-f715-4391-8509-3cf0483438de tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:59.497375 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-75f8c2d1-f715-4391-8509-3cf0483438de tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:59.498138 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-75f8c2d1-f715-4391-8509-3cf0483438de tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:59.498566 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-75f8c2d1-f715-4391-8509-3cf0483438de tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:59.666636 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-75f8c2d1-f715-4391-8509-3cf0483438de tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7575179edbda45208561c983fc5b956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20763921c37c4e81bba702e09bf628b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:04:59.676036 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-75f8c2d1-f715-4391-8509-3cf0483438de tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a" status: 200 len: 1367 microversion: 2.1 time: 0.193329 May 30 12:04:59.685345 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 66/122] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:04:59 2022] GET /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a => generated 1367 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:05:00.030494 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-ea66e2aa-413c-4a31-b182-3c507cce0b45 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:00.035593 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-ea66e2aa-413c-4a31-b182-3c507cce0b45 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 8542b17d-0c65-4c5d-bc97-9d17545e2126] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:00.048638 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ea66e2aa-413c-4a31-b182-3c507cce0b45 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:00.049563 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ea66e2aa-413c-4a31-b182-3c507cce0b45 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:00.050956 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ea66e2aa-413c-4a31-b182-3c507cce0b45 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:00.051806 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ea66e2aa-413c-4a31-b182-3c507cce0b45 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:00.292766 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-aa6958b0-4a54-4807-8a7d-1b9e2d3d81af tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] 10.222.0.32 "POST /compute/v2.1/servers/5a06904b-d932-4635-90df-b69dcb15d941/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.936931 May 30 12:05:00.294301 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 57/123] 10.222.0.32 () {60 vars in 1322 bytes} [Mon May 30 12:04:58 2022] POST /compute/v2.1/servers/5a06904b-d932-4635-90df-b69dcb15d941/os-volume_attachments => generated 194 bytes in 1941 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:05:00.305739 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-e516d0bf-5531-4419-a9b2-4447c612b3f9 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:00.306449 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-e516d0bf-5531-4419-a9b2-4447c612b3f9 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 08b1b860-516e-4041-8df8-1fa8cc65a4ed] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:00.312749 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-ea66e2aa-413c-4a31-b182-3c507cce0b45 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:00.324031 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e516d0bf-5531-4419-a9b2-4447c612b3f9 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:00.324520 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-ea66e2aa-413c-4a31-b182-3c507cce0b45 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126" status: 200 len: 1321 microversion: 2.1 time: 0.312351 May 30 12:05:00.324717 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e516d0bf-5531-4419-a9b2-4447c612b3f9 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:00.325176 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 67/124] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:00 2022] GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126 => generated 1321 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:05:00.325922 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e516d0bf-5531-4419-a9b2-4447c612b3f9 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:00.326522 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e516d0bf-5531-4419-a9b2-4447c612b3f9 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:00.509339 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-91718544-4091-418f-94a3-68d710d1d3c3 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:00.510229 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-91718544-4091-418f-94a3-68d710d1d3c3 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:00.538036 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-91718544-4091-418f-94a3-68d710d1d3c3 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:00.538490 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-91718544-4091-418f-94a3-68d710d1d3c3 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:00.539271 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-91718544-4091-418f-94a3-68d710d1d3c3 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:00.539704 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-91718544-4091-418f-94a3-68d710d1d3c3 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:00.658125 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-e516d0bf-5531-4419-a9b2-4447c612b3f9 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76e8d7bfdc04ea79c83ca7fb6b9ade1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5074cf3e6248668995f266845c8969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:00.670071 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-e516d0bf-5531-4419-a9b2-4447c612b3f9 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed" status: 200 len: 1362 microversion: 2.1 time: 0.373184 May 30 12:05:00.681772 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 58/125] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:00 2022] GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed => generated 1362 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:05:00.699451 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-d749bab8-59b1-40c7-b684-c9ea202c397f tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:00.703242 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-d749bab8-59b1-40c7-b684-c9ea202c397f tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: 54ad4de0-2282-4baf-86a4-40d5ba1ba62a] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:00.720927 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d749bab8-59b1-40c7-b684-c9ea202c397f tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:00.721890 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d749bab8-59b1-40c7-b684-c9ea202c397f tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:00.722967 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d749bab8-59b1-40c7-b684-c9ea202c397f tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:00.723613 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d749bab8-59b1-40c7-b684-c9ea202c397f tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:00.795083 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-91718544-4091-418f-94a3-68d710d1d3c3 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:00.805081 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-91718544-4091-418f-94a3-68d710d1d3c3 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:00.806577 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-91718544-4091-418f-94a3-68d710d1d3c3 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:00.807767 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-91718544-4091-418f-94a3-68d710d1d3c3 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1599 microversion: 2.20 time: 0.305251 May 30 12:05:00.808339 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 68/126] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:05:00 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1599 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:05:00.826698 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-6ddaa3a8-aec0-4451-afba-d3ec0fe6e1a5 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:00.827196 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-6ddaa3a8-aec0-4451-afba-d3ec0fe6e1a5 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:00.834080 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-6ddaa3a8-aec0-4451-afba-d3ec0fe6e1a5 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:00.834575 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-6ddaa3a8-aec0-4451-afba-d3ec0fe6e1a5 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:00.835358 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-6ddaa3a8-aec0-4451-afba-d3ec0fe6e1a5 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:00.836415 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-6ddaa3a8-aec0-4451-afba-d3ec0fe6e1a5 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:00.988773 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-d749bab8-59b1-40c7-b684-c9ea202c397f tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7575179edbda45208561c983fc5b956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20763921c37c4e81bba702e09bf628b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:00.997177 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-6ddaa3a8-aec0-4451-afba-d3ec0fe6e1a5 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.175170 May 30 12:05:00.997767 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 69/127] 10.222.0.32 () {60 vars in 1315 bytes} [Mon May 30 12:05:00 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c/os-interface => generated 284 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 30 12:05:00.998717 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-d749bab8-59b1-40c7-b684-c9ea202c397f tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a" status: 200 len: 1367 microversion: 2.1 time: 0.308860 May 30 12:05:00.999453 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 59/128] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:00 2022] GET /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a => generated 1367 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:05:01.305007 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-94ba8fc4-8c97-480d-92f4-d835a1f2a8e8 req-a34722de-2939-43e2-b63f-f6eaccefab63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8542b17d-0c65-4c5d-bc97-9d17545e2126", "name": "network-vif-plugged", "status": "completed", "tag": "1f1b1022-04af-4f21-b1e6-4960bf03a94c"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:05:01.318531 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-94ba8fc4-8c97-480d-92f4-d835a1f2a8e8 req-a34722de-2939-43e2-b63f-f6eaccefab63 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:01.331454 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-94ba8fc4-8c97-480d-92f4-d835a1f2a8e8 req-a34722de-2939-43e2-b63f-f6eaccefab63 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:01.348947 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-a902d081-a4fd-4933-b70a-c312e7a8f126 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:01.354330 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-a902d081-a4fd-4933-b70a-c312e7a8f126 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 8542b17d-0c65-4c5d-bc97-9d17545e2126] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:01.365166 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-94ba8fc4-8c97-480d-92f4-d835a1f2a8e8 req-a34722de-2939-43e2-b63f-f6eaccefab63 service nova] Creating event network-vif-plugged:1f1b1022-04af-4f21-b1e6-4960bf03a94c for instance 8542b17d-0c65-4c5d-bc97-9d17545e2126 on hv-cinder-84051 May 30 12:05:01.378204 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-94ba8fc4-8c97-480d-92f4-d835a1f2a8e8 req-a34722de-2939-43e2-b63f-f6eaccefab63 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079376 May 30 12:05:01.380083 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a902d081-a4fd-4933-b70a-c312e7a8f126 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:01.380519 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a902d081-a4fd-4933-b70a-c312e7a8f126 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:01.381387 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 70/129] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:05:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:05:01.387292 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a902d081-a4fd-4933-b70a-c312e7a8f126 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:01.387852 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a902d081-a4fd-4933-b70a-c312e7a8f126 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:01.696058 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-37368188-6235-4af3-bc05-8a0fe95dd608 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:01.697715 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-37368188-6235-4af3-bc05-8a0fe95dd608 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 08b1b860-516e-4041-8df8-1fa8cc65a4ed] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:01.711449 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-a902d081-a4fd-4933-b70a-c312e7a8f126 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:01.714786 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-37368188-6235-4af3-bc05-8a0fe95dd608 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:01.715241 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-37368188-6235-4af3-bc05-8a0fe95dd608 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:01.716020 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-37368188-6235-4af3-bc05-8a0fe95dd608 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:01.725929 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-37368188-6235-4af3-bc05-8a0fe95dd608 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:01.726408 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-a902d081-a4fd-4933-b70a-c312e7a8f126 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126" status: 200 len: 1321 microversion: 2.1 time: 0.380921 May 30 12:05:01.728775 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 60/130] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:01 2022] GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126 => generated 1321 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:05:01.971471 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-37368188-6235-4af3-bc05-8a0fe95dd608 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76e8d7bfdc04ea79c83ca7fb6b9ade1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5074cf3e6248668995f266845c8969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:01.981983 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-37368188-6235-4af3-bc05-8a0fe95dd608 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed" status: 200 len: 1548 microversion: 2.1 time: 0.297747 May 30 12:05:02.000276 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 71/131] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:01 2022] GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed => generated 1548 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:05:02.003731 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-e98cf08d-0144-4751-8806-8fad4219c618 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:02.004691 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-e98cf08d-0144-4751-8806-8fad4219c618 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 08b1b860-516e-4041-8df8-1fa8cc65a4ed] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:02.011158 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e98cf08d-0144-4751-8806-8fad4219c618 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:02.016370 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-7c1ed9e2-e0a0-42cc-8420-624b171deeca tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:02.016967 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e98cf08d-0144-4751-8806-8fad4219c618 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:02.018065 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e98cf08d-0144-4751-8806-8fad4219c618 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:02.018580 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e98cf08d-0144-4751-8806-8fad4219c618 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:02.023755 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-7c1ed9e2-e0a0-42cc-8420-624b171deeca tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: 54ad4de0-2282-4baf-86a4-40d5ba1ba62a] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:02.039520 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7c1ed9e2-e0a0-42cc-8420-624b171deeca tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:02.040078 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7c1ed9e2-e0a0-42cc-8420-624b171deeca tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:02.040970 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7c1ed9e2-e0a0-42cc-8420-624b171deeca tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:02.041501 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7c1ed9e2-e0a0-42cc-8420-624b171deeca tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:02.149060 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-e98cf08d-0144-4751-8806-8fad4219c618 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.149528 May 30 12:05:02.156396 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 61/132] 10.222.0.32 () {58 vars in 1274 bytes} [Mon May 30 12:05:01 2022] GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed/os-interface => generated 284 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:05:02.410411 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-7c1ed9e2-e0a0-42cc-8420-624b171deeca tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7575179edbda45208561c983fc5b956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20763921c37c4e81bba702e09bf628b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:02.419738 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-7c1ed9e2-e0a0-42cc-8420-624b171deeca tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a" status: 200 len: 1367 microversion: 2.1 time: 0.407084 May 30 12:05:02.446568 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 72/133] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:02 2022] GET /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a => generated 1367 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:05:02.750327 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-01b3ea28-11bd-4f8e-a330-c7e5514112fe tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:02.752610 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-01b3ea28-11bd-4f8e-a330-c7e5514112fe tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 8542b17d-0c65-4c5d-bc97-9d17545e2126] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:02.761392 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-01b3ea28-11bd-4f8e-a330-c7e5514112fe tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:02.762128 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-01b3ea28-11bd-4f8e-a330-c7e5514112fe tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:02.763088 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-01b3ea28-11bd-4f8e-a330-c7e5514112fe tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:02.763734 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-01b3ea28-11bd-4f8e-a330-c7e5514112fe tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:03.343896 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-870b05ea-0c7d-470f-af6f-955b74bc7d17 req-bebf2a84-3811-4fde-8313-b771b30f0e7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "314658c0-2ad4-4987-99bc-f8acf2d7e46c", "tag": "66de87a6-f3b1-41fb-8926-85240efcbe51"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:05:03.361885 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-870b05ea-0c7d-470f-af6f-955b74bc7d17 req-bebf2a84-3811-4fde-8313-b771b30f0e7a service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:03.362344 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-870b05ea-0c7d-470f-af6f-955b74bc7d17 req-bebf2a84-3811-4fde-8313-b771b30f0e7a service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:03.368627 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell1:SELECT=100 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:05:03.382007 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-870b05ea-0c7d-470f-af6f-955b74bc7d17 req-bebf2a84-3811-4fde-8313-b771b30f0e7a service nova] Creating event network-changed:66de87a6-f3b1-41fb-8926-85240efcbe51 for instance 314658c0-2ad4-4987-99bc-f8acf2d7e46c on hv-cinder-84051 May 30 12:05:03.388304 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-870b05ea-0c7d-470f-af6f-955b74bc7d17 req-bebf2a84-3811-4fde-8313-b771b30f0e7a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049403 May 30 12:05:03.393838 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 73/134] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:05:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 30 12:05:03.452973 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-a68bde08-bbd1-4a7b-8af1-9254724754e5 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:03.454626 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-a68bde08-bbd1-4a7b-8af1-9254724754e5 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: 54ad4de0-2282-4baf-86a4-40d5ba1ba62a] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:03.472606 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a68bde08-bbd1-4a7b-8af1-9254724754e5 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:03.473192 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a68bde08-bbd1-4a7b-8af1-9254724754e5 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:03.474138 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a68bde08-bbd1-4a7b-8af1-9254724754e5 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:03.474518 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a68bde08-bbd1-4a7b-8af1-9254724754e5 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:03.533594 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-01b3ea28-11bd-4f8e-a330-c7e5514112fe tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:03.543976 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-01b3ea28-11bd-4f8e-a330-c7e5514112fe tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126" status: 200 len: 1321 microversion: 2.1 time: 0.801888 May 30 12:05:03.545084 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 62/135] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:02 2022] GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126 => generated 1321 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:05:03.797330 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-a68bde08-bbd1-4a7b-8af1-9254724754e5 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7575179edbda45208561c983fc5b956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20763921c37c4e81bba702e09bf628b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:03.809918 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-a68bde08-bbd1-4a7b-8af1-9254724754e5 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a" status: 200 len: 1557 microversion: 2.1 time: 0.375210 May 30 12:05:03.822485 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 74/136] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:03 2022] GET /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a => generated 1557 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:05:03.829479 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-c8f5f5ea-4307-4964-b7e5-0fcca577e09e tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:03.829983 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-c8f5f5ea-4307-4964-b7e5-0fcca577e09e tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: 54ad4de0-2282-4baf-86a4-40d5ba1ba62a] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:03.843138 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c8f5f5ea-4307-4964-b7e5-0fcca577e09e tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:03.843589 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c8f5f5ea-4307-4964-b7e5-0fcca577e09e tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:03.844430 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c8f5f5ea-4307-4964-b7e5-0fcca577e09e tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:03.844873 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c8f5f5ea-4307-4964-b7e5-0fcca577e09e tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:03.979135 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-c8f5f5ea-4307-4964-b7e5-0fcca577e09e tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.154219 May 30 12:05:03.979726 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 63/137] 10.222.0.32 () {58 vars in 1274 bytes} [Mon May 30 12:05:03 2022] GET /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a/os-interface => generated 285 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:05:04.565325 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-f3e90eef-fbc2-4ea2-bcd7-71d246b372c0 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:04.566697 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-f3e90eef-fbc2-4ea2-bcd7-71d246b372c0 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 8542b17d-0c65-4c5d-bc97-9d17545e2126] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:04.575248 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f3e90eef-fbc2-4ea2-bcd7-71d246b372c0 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:04.576611 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f3e90eef-fbc2-4ea2-bcd7-71d246b372c0 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:04.579680 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f3e90eef-fbc2-4ea2-bcd7-71d246b372c0 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:04.581516 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f3e90eef-fbc2-4ea2-bcd7-71d246b372c0 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:04.690574 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-af4093fd-3736-4b19-880e-706ae913f0bc req-5eb9dd39-e962-4ded-b579-44a0ad965b86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08b1b860-516e-4041-8df8-1fa8cc65a4ed", "tag": "2d71add9-9fe3-4c66-b490-513b1ce61d40"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:05:04.722987 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-af4093fd-3736-4b19-880e-706ae913f0bc req-5eb9dd39-e962-4ded-b579-44a0ad965b86 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:04.725576 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-af4093fd-3736-4b19-880e-706ae913f0bc req-5eb9dd39-e962-4ded-b579-44a0ad965b86 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:04.747931 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-af4093fd-3736-4b19-880e-706ae913f0bc req-5eb9dd39-e962-4ded-b579-44a0ad965b86 service nova] Creating event network-changed:2d71add9-9fe3-4c66-b490-513b1ce61d40 for instance 08b1b860-516e-4041-8df8-1fa8cc65a4ed on hv-cinder-84051 May 30 12:05:04.778037 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-af4093fd-3736-4b19-880e-706ae913f0bc req-5eb9dd39-e962-4ded-b579-44a0ad965b86 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091666 May 30 12:05:04.781244 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 64/138] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:05:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:05:05.122018 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-f3e90eef-fbc2-4ea2-bcd7-71d246b372c0 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:05.136352 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-f3e90eef-fbc2-4ea2-bcd7-71d246b372c0 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126" status: 200 len: 1321 microversion: 2.1 time: 0.576744 May 30 12:05:05.139798 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 75/139] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:04 2022] GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126 => generated 1321 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:05:06.164197 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-7cd602cb-7f3f-475a-9f48-7ed7c93055a8 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:06.167391 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-7cd602cb-7f3f-475a-9f48-7ed7c93055a8 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 8542b17d-0c65-4c5d-bc97-9d17545e2126] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:06.184349 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7cd602cb-7f3f-475a-9f48-7ed7c93055a8 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:06.185818 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7cd602cb-7f3f-475a-9f48-7ed7c93055a8 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:06.186792 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7cd602cb-7f3f-475a-9f48-7ed7c93055a8 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:06.187540 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7cd602cb-7f3f-475a-9f48-7ed7c93055a8 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:06.747167 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-7cd602cb-7f3f-475a-9f48-7ed7c93055a8 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:06.759071 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-7cd602cb-7f3f-475a-9f48-7ed7c93055a8 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126" status: 200 len: 1515 microversion: 2.1 time: 0.605237 May 30 12:05:06.764540 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 65/140] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:06 2022] GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126 => generated 1515 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:05:06.784016 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-1e9d0f06-799c-48d7-b8fd-9938d36f078b tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:05:06.785313 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-1e9d0f06-799c-48d7-b8fd-9938d36f078b tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 8542b17d-0c65-4c5d-bc97-9d17545e2126] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:06.814699 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-73447587-703c-45ac-ab6f-533f2675578f req-bec2b3d8-527a-40de-8bf6-0dcd939e5d6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54ad4de0-2282-4baf-86a4-40d5ba1ba62a", "tag": "f3718156-6792-4881-a093-e2245a9c75e4"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:05:06.816194 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1e9d0f06-799c-48d7-b8fd-9938d36f078b tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:06.817601 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1e9d0f06-799c-48d7-b8fd-9938d36f078b tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:06.820059 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1e9d0f06-799c-48d7-b8fd-9938d36f078b tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:06.820622 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1e9d0f06-799c-48d7-b8fd-9938d36f078b tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:06.836296 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-73447587-703c-45ac-ab6f-533f2675578f req-bec2b3d8-527a-40de-8bf6-0dcd939e5d6b service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:06.836750 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-73447587-703c-45ac-ab6f-533f2675578f req-bec2b3d8-527a-40de-8bf6-0dcd939e5d6b service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:06.866728 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-73447587-703c-45ac-ab6f-533f2675578f req-bec2b3d8-527a-40de-8bf6-0dcd939e5d6b service nova] Creating event network-changed:f3718156-6792-4881-a093-e2245a9c75e4 for instance 54ad4de0-2282-4baf-86a4-40d5ba1ba62a on hv-cinder-84051 May 30 12:05:06.872482 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-73447587-703c-45ac-ab6f-533f2675578f req-bec2b3d8-527a-40de-8bf6-0dcd939e5d6b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062805 May 30 12:05:06.873354 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 66/141] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:05:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:05:06.879189 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.objects.instance [None req-1e9d0f06-799c-48d7-b8fd-9938d36f078b tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lazy-loading 'flavor' on Instance uuid 8542b17d-0c65-4c5d-bc97-9d17545e2126 {{(pid=117671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 30 12:05:07.124545 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-1e9d0f06-799c-48d7-b8fd-9938d36f078b tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "POST /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126/action" status: 200 len: 32 microversion: 2.1 time: 0.346172 May 30 12:05:07.126909 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 76/142] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 30 12:05:06 2022] POST /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126/action => generated 32 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 30 12:05:07.138645 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-687cebde-dda9-4b2a-881e-704aa1f246a4 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:07.140309 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-687cebde-dda9-4b2a-881e-704aa1f246a4 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 8542b17d-0c65-4c5d-bc97-9d17545e2126] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:07.159339 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-687cebde-dda9-4b2a-881e-704aa1f246a4 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:07.161230 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-687cebde-dda9-4b2a-881e-704aa1f246a4 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:07.162936 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-687cebde-dda9-4b2a-881e-704aa1f246a4 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:07.177360 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-687cebde-dda9-4b2a-881e-704aa1f246a4 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:07.521047 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-687cebde-dda9-4b2a-881e-704aa1f246a4 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:07.537317 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-687cebde-dda9-4b2a-881e-704aa1f246a4 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126" status: 200 len: 1521 microversion: 2.1 time: 0.401508 May 30 12:05:07.538154 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 67/143] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:07 2022] GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126 => generated 1521 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:05:08.558471 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-ef778afb-262f-43c1-ad93-e5c45a8d36ac tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:08.559396 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-ef778afb-262f-43c1-ad93-e5c45a8d36ac tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 8542b17d-0c65-4c5d-bc97-9d17545e2126] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:08.566934 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ef778afb-262f-43c1-ad93-e5c45a8d36ac tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:08.567391 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ef778afb-262f-43c1-ad93-e5c45a8d36ac tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:08.568192 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ef778afb-262f-43c1-ad93-e5c45a8d36ac tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:08.568641 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ef778afb-262f-43c1-ad93-e5c45a8d36ac tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:08.752203 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-ef778afb-262f-43c1-ad93-e5c45a8d36ac tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:08.760267 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-ef778afb-262f-43c1-ad93-e5c45a8d36ac tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126" status: 200 len: 1521 microversion: 2.1 time: 0.208824 May 30 12:05:08.760848 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 77/144] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:08 2022] GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126 => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:05:09.778511 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-181dc5f5-d786-4cf7-a567-39a94f93d68b tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:09.779138 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-181dc5f5-d786-4cf7-a567-39a94f93d68b tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 8542b17d-0c65-4c5d-bc97-9d17545e2126] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:09.786186 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-181dc5f5-d786-4cf7-a567-39a94f93d68b tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:09.786651 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-181dc5f5-d786-4cf7-a567-39a94f93d68b tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:09.787398 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-181dc5f5-d786-4cf7-a567-39a94f93d68b tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:09.787830 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-181dc5f5-d786-4cf7-a567-39a94f93d68b tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:09.792025 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:05:09.921935 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-181dc5f5-d786-4cf7-a567-39a94f93d68b tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:09.930301 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-181dc5f5-d786-4cf7-a567-39a94f93d68b tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126" status: 200 len: 1521 microversion: 2.1 time: 0.155662 May 30 12:05:09.931055 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 68/145] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:09 2022] GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:05:10.833056 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-e8ea72cd-f796-46be-945d-e06558d526c7 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:10.833635 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-e8ea72cd-f796-46be-945d-e06558d526c7 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] [instance: 5a06904b-d932-4635-90df-b69dcb15d941] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:10.840089 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e8ea72cd-f796-46be-945d-e06558d526c7 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:10.840654 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e8ea72cd-f796-46be-945d-e06558d526c7 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:10.841430 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e8ea72cd-f796-46be-945d-e06558d526c7 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:10.841926 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e8ea72cd-f796-46be-945d-e06558d526c7 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:10.870218 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-e8ea72cd-f796-46be-945d-e06558d526c7 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] [instance: 5a06904b-d932-4635-90df-b69dcb15d941] Going to try to terminate instance {{(pid=117671) delete /opt/stack/nova/nova/compute/api.py:2664}} May 30 12:05:10.957944 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-090a6671-19fb-406a-9f4b-8d19c8d40ef3 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:10.958701 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-090a6671-19fb-406a-9f4b-8d19c8d40ef3 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 8542b17d-0c65-4c5d-bc97-9d17545e2126] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:10.965312 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-e8ea72cd-f796-46be-945d-e06558d526c7 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] 10.222.0.32 "DELETE /compute/v2.1/servers/5a06904b-d932-4635-90df-b69dcb15d941" status: 204 len: 0 microversion: 2.1 time: 0.136594 May 30 12:05:10.965855 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-090a6671-19fb-406a-9f4b-8d19c8d40ef3 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:10.966238 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 78/146] 10.222.0.32 () {58 vars in 1238 bytes} [Mon May 30 12:05:10 2022] DELETE /compute/v2.1/servers/5a06904b-d932-4635-90df-b69dcb15d941 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 30 12:05:10.971283 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-090a6671-19fb-406a-9f4b-8d19c8d40ef3 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:10.973012 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-090a6671-19fb-406a-9f4b-8d19c8d40ef3 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:10.973538 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-090a6671-19fb-406a-9f4b-8d19c8d40ef3 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:10.974965 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-da76cd2f-4911-4299-a39c-b6123a31cdf1 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:10.975643 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-da76cd2f-4911-4299-a39c-b6123a31cdf1 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] [instance: 5a06904b-d932-4635-90df-b69dcb15d941] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:10.982312 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-da76cd2f-4911-4299-a39c-b6123a31cdf1 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:10.982758 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-da76cd2f-4911-4299-a39c-b6123a31cdf1 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:10.983532 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-da76cd2f-4911-4299-a39c-b6123a31cdf1 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:10.985269 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-da76cd2f-4911-4299-a39c-b6123a31cdf1 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:11.205561 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-090a6671-19fb-406a-9f4b-8d19c8d40ef3 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:11.213125 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-090a6671-19fb-406a-9f4b-8d19c8d40ef3 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126" status: 200 len: 1521 microversion: 2.1 time: 0.268709 May 30 12:05:11.213812 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 69/147] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:10 2022] GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126 => generated 1521 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:05:11.218025 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-da76cd2f-4911-4299-a39c-b6123a31cdf1 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e591526a8c3645de9c5965a40f8ef90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60b241805384ef49352b3791cfd3d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:11.227372 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-da76cd2f-4911-4299-a39c-b6123a31cdf1 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] 10.222.0.32 "GET /compute/v2.1/servers/5a06904b-d932-4635-90df-b69dcb15d941" status: 200 len: 1553 microversion: 2.1 time: 0.256586 May 30 12:05:11.227944 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 79/148] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:10 2022] GET /compute/v2.1/servers/5a06904b-d932-4635-90df-b69dcb15d941 => generated 1553 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:05:12.232063 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-fb7be5b6-0010-408d-bfa6-5b3e1b4ede66 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:12.232783 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-fb7be5b6-0010-408d-bfa6-5b3e1b4ede66 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 8542b17d-0c65-4c5d-bc97-9d17545e2126] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:12.242196 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-fb7be5b6-0010-408d-bfa6-5b3e1b4ede66 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:12.243025 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-fb7be5b6-0010-408d-bfa6-5b3e1b4ede66 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:12.244625 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-fb7be5b6-0010-408d-bfa6-5b3e1b4ede66 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:12.245537 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-fb7be5b6-0010-408d-bfa6-5b3e1b4ede66 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:12.247580 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-0e3eb72c-f7eb-4b08-8e20-b7bd8184c19d tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:12.248537 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-0e3eb72c-f7eb-4b08-8e20-b7bd8184c19d tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] [instance: 5a06904b-d932-4635-90df-b69dcb15d941] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:12.261851 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0e3eb72c-f7eb-4b08-8e20-b7bd8184c19d tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:12.262466 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0e3eb72c-f7eb-4b08-8e20-b7bd8184c19d tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:12.263214 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0e3eb72c-f7eb-4b08-8e20-b7bd8184c19d tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:12.263890 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0e3eb72c-f7eb-4b08-8e20-b7bd8184c19d tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:12.476719 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-fb7be5b6-0010-408d-bfa6-5b3e1b4ede66 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:12.491794 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-fb7be5b6-0010-408d-bfa6-5b3e1b4ede66 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126" status: 200 len: 1521 microversion: 2.1 time: 0.263528 May 30 12:05:12.492899 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 70/149] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:12 2022] GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126 => generated 1521 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:05:12.503068 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-0e3eb72c-f7eb-4b08-8e20-b7bd8184c19d tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e591526a8c3645de9c5965a40f8ef90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60b241805384ef49352b3791cfd3d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:12.511668 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-0e3eb72c-f7eb-4b08-8e20-b7bd8184c19d tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] 10.222.0.32 "GET /compute/v2.1/servers/5a06904b-d932-4635-90df-b69dcb15d941" status: 200 len: 1553 microversion: 2.1 time: 0.269687 May 30 12:05:12.512265 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 80/150] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:12 2022] GET /compute/v2.1/servers/5a06904b-d932-4635-90df-b69dcb15d941 => generated 1553 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:05:13.511811 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-8a2caba4-ab5a-4c41-aab6-c573eb37a938 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:13.512512 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-8a2caba4-ab5a-4c41-aab6-c573eb37a938 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 8542b17d-0c65-4c5d-bc97-9d17545e2126] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:13.528093 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8a2caba4-ab5a-4c41-aab6-c573eb37a938 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:13.528588 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8a2caba4-ab5a-4c41-aab6-c573eb37a938 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:13.529609 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8a2caba4-ab5a-4c41-aab6-c573eb37a938 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:13.529912 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-614285d1-aaa3-48a0-bb88-426c978e8744 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:13.530668 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-614285d1-aaa3-48a0-bb88-426c978e8744 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] [instance: 5a06904b-d932-4635-90df-b69dcb15d941] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:13.532009 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8a2caba4-ab5a-4c41-aab6-c573eb37a938 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:13.550691 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-614285d1-aaa3-48a0-bb88-426c978e8744 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:13.551158 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-614285d1-aaa3-48a0-bb88-426c978e8744 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:13.551999 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-614285d1-aaa3-48a0-bb88-426c978e8744 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:13.552461 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-614285d1-aaa3-48a0-bb88-426c978e8744 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:13.798595 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-8a2caba4-ab5a-4c41-aab6-c573eb37a938 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:13.807527 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-8a2caba4-ab5a-4c41-aab6-c573eb37a938 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126" status: 200 len: 1521 microversion: 2.1 time: 0.300537 May 30 12:05:13.808552 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 71/151] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:13 2022] GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126 => generated 1521 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:05:13.823541 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-614285d1-aaa3-48a0-bb88-426c978e8744 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e591526a8c3645de9c5965a40f8ef90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60b241805384ef49352b3791cfd3d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:13.833897 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-614285d1-aaa3-48a0-bb88-426c978e8744 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] 10.222.0.32 "GET /compute/v2.1/servers/5a06904b-d932-4635-90df-b69dcb15d941" status: 200 len: 1553 microversion: 2.1 time: 0.308116 May 30 12:05:13.843462 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 81/152] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:13 2022] GET /compute/v2.1/servers/5a06904b-d932-4635-90df-b69dcb15d941 => generated 1553 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:05:14.160471 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-913757c0-01d2-417a-82d7-d01c6d183159 req-3e049ea9-66ae-4597-bd9b-ba70b921aae4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a06904b-d932-4635-90df-b69dcb15d941", "name": "network-vif-deleted", "tag": "4fecff73-c0eb-4774-9017-6b7fd73b4455"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:05:14.168627 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-913757c0-01d2-417a-82d7-d01c6d183159 req-3e049ea9-66ae-4597-bd9b-ba70b921aae4 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:14.168981 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-913757c0-01d2-417a-82d7-d01c6d183159 req-3e049ea9-66ae-4597-bd9b-ba70b921aae4 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:14.181468 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-913757c0-01d2-417a-82d7-d01c6d183159 req-3e049ea9-66ae-4597-bd9b-ba70b921aae4 service nova] Creating event network-vif-deleted:4fecff73-c0eb-4774-9017-6b7fd73b4455 for instance 5a06904b-d932-4635-90df-b69dcb15d941 on hv-cinder-84051 May 30 12:05:14.186586 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-913757c0-01d2-417a-82d7-d01c6d183159 req-3e049ea9-66ae-4597-bd9b-ba70b921aae4 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031133 May 30 12:05:14.188088 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 72/153] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:05:14.826311 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-2722bfac-f715-4667-adc5-90f4b695d4ff tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:14.827064 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-2722bfac-f715-4667-adc5-90f4b695d4ff tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 8542b17d-0c65-4c5d-bc97-9d17545e2126] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:14.834250 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2722bfac-f715-4667-adc5-90f4b695d4ff tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:14.834705 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2722bfac-f715-4667-adc5-90f4b695d4ff tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:14.835484 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2722bfac-f715-4667-adc5-90f4b695d4ff tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:14.835914 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2722bfac-f715-4667-adc5-90f4b695d4ff tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:14.851831 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-04617984-6f59-432f-b90f-7a5847568cd9 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:14.852628 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-04617984-6f59-432f-b90f-7a5847568cd9 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] [instance: 5a06904b-d932-4635-90df-b69dcb15d941] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:14.862338 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-04617984-6f59-432f-b90f-7a5847568cd9 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:14.862847 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-04617984-6f59-432f-b90f-7a5847568cd9 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:14.863603 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-04617984-6f59-432f-b90f-7a5847568cd9 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:14.864019 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-04617984-6f59-432f-b90f-7a5847568cd9 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:14.911443 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-04617984-6f59-432f-b90f-7a5847568cd9 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:14.911895 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-04617984-6f59-432f-b90f-7a5847568cd9 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:14.912569 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.objects.instance [None req-04617984-6f59-432f-b90f-7a5847568cd9 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lazy-loading 'fault' on Instance uuid 5a06904b-d932-4635-90df-b69dcb15d941 {{(pid=117670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 30 12:05:14.982760 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-04617984-6f59-432f-b90f-7a5847568cd9 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e591526a8c3645de9c5965a40f8ef90a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60b241805384ef49352b3791cfd3d8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:14.992979 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-04617984-6f59-432f-b90f-7a5847568cd9 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] 10.222.0.32 "GET /compute/v2.1/servers/5a06904b-d932-4635-90df-b69dcb15d941" status: 200 len: 1350 microversion: 2.1 time: 0.145609 May 30 12:05:14.993743 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 73/154] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:14 2022] GET /compute/v2.1/servers/5a06904b-d932-4635-90df-b69dcb15d941 => generated 1350 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:05:15.073192 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-2722bfac-f715-4667-adc5-90f4b695d4ff tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:15.088255 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-2722bfac-f715-4667-adc5-90f4b695d4ff tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126" status: 200 len: 1521 microversion: 2.1 time: 0.265341 May 30 12:05:15.097144 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 82/155] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:14 2022] GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126 => generated 1521 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:05:16.010854 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-59181185-449a-4cb3-b9d9-f6a2c0f108b0 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:16.011478 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-59181185-449a-4cb3-b9d9-f6a2c0f108b0 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] [instance: 5a06904b-d932-4635-90df-b69dcb15d941] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:16.019474 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-59181185-449a-4cb3-b9d9-f6a2c0f108b0 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:16.020443 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-59181185-449a-4cb3-b9d9-f6a2c0f108b0 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:16.021289 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-59181185-449a-4cb3-b9d9-f6a2c0f108b0 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:16.021915 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-59181185-449a-4cb3-b9d9-f6a2c0f108b0 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:16.044914 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.wsgi [None req-59181185-449a-4cb3-b9d9-f6a2c0f108b0 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] HTTP exception thrown: Instance 5a06904b-d932-4635-90df-b69dcb15d941 could not be found. May 30 12:05:16.050236 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-59181185-449a-4cb3-b9d9-f6a2c0f108b0 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Request method failure captured: May 30 12:05:16.050236 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: request: GET /compute/v2.1/servers/5a06904b-d932-4635-90df-b69dcb15d941 HTTP/1.1 May 30 12:05:16.050236 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Accept: application/json May 30 12:05:16.050236 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Accept-Encoding: identity May 30 12:05:16.050236 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Connection: close May 30 12:05:16.050236 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Content-Length: 0 May 30 12:05:16.050236 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Content-Type: application/json May 30 12:05:16.050236 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Host: 10.222.0.32 May 30 12:05:16.050236 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Openstack-System-Scope: None May 30 12:05:16.050236 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: User-Agent: python-urllib3/1.26.9 May 30 12:05:16.050236 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Auth-Token: gAAAAABilLK3iXHYpYWvSNGMawozRs1eyDVX6wioG6pSA_nTpBdwJ7dwTEgezoPz7jN-jdFudSR4DUsdqzPttdxfyQcWg9ah8pjARsIW-ZI5POywJ5Gc8y22dsxgqiwEDnUk79hfmt-pfcOaqtShNQZ2sSczAyz06KvLpjDR1UA1XsligXs_5Q8 May 30 12:05:16.050236 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Domain-Id: None May 30 12:05:16.050236 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Domain-Name: None May 30 12:05:16.050236 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Identity-Status: Confirmed May 30 12:05:16.050236 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Is-Admin-Project: True May 30 12:05:16.050236 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Domain-Id: default May 30 12:05:16.050236 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Domain-Name: Default May 30 12:05:16.050236 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Id: a60b241805384ef49352b3791cfd3d8c May 30 12:05:16.050236 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Name: tempest-DeleteServersTestJSON-1844435369 May 30 12:05:16.050236 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Role: reader,member May 30 12:05:16.050236 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Roles: reader,member May 30 12:05:16.051673 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/a60b241805384ef49352b3791cfd3d8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/a60b241805384ef49352b3791cfd3d8c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/a60b241805384ef49352b3791cfd3d8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_a60b241805384ef49352b3791cfd3d8c", "adminURL": "http://10.222.0.32:8080"}]}] May 30 12:05:16.051673 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant: tempest-DeleteServersTestJSON-1844435369 May 30 12:05:16.051673 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant-Id: a60b241805384ef49352b3791cfd3d8c May 30 12:05:16.051673 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant-Name: tempest-DeleteServersTestJSON-1844435369 May 30 12:05:16.051673 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User: tempest-DeleteServersTestJSON-1844435369-project May 30 12:05:16.051673 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Domain-Id: default May 30 12:05:16.051673 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Domain-Name: Default May 30 12:05:16.051673 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Id: e591526a8c3645de9c5965a40f8ef90a May 30 12:05:16.051673 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Name: tempest-DeleteServersTestJSON-1844435369-project May 30 12:05:16.051673 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: method: > May 30 12:05:16.051673 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: exception: Instance 5a06904b-d932-4635-90df-b69dcb15d941 could not be found. May 30 12:05:16.051673 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: action_args: {'id': '5a06904b-d932-4635-90df-b69dcb15d941'} May 30 12:05:16.052507 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:05:16.052507 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:05:16.052507 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:05:16.052507 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:05:16.052507 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:05:16.052507 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:05:16.052507 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:05:16.052507 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:05:16.052507 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:05:16.052507 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:05:16.052507 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a06904b-d932-4635-90df-b69dcb15d941 could not be found. May 30 12:05:16.052507 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:05:16.052507 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:05:16.052507 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:05:16.052507 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:05:16.052507 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:05:16.052507 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:05:16.052507 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:05:16.052507 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:05:16.052507 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:05:16.053606 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:05:16.053606 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 30 12:05:16.053606 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 30 12:05:16.053606 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 30 12:05:16.053606 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 30 12:05:16.053606 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:05:16.053606 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:05:16.053606 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a06904b-d932-4635-90df-b69dcb15d941 could not be found. May 30 12:05:16.053606 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:05:16.053606 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:05:16.053606 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:05:16.053606 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:05:16.053606 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:05:16.053606 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:05:16.053606 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:05:16.053606 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:05:16.053606 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a06904b-d932-4635-90df-b69dcb15d941 could not be found. May 30 12:05:16.053606 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:05:16.054602 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-59181185-449a-4cb3-b9d9-f6a2c0f108b0 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Returning 404 to user: Instance 5a06904b-d932-4635-90df-b69dcb15d941 could not be found. {{(pid=117670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:05:16.054602 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-59181185-449a-4cb3-b9d9-f6a2c0f108b0 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] 10.222.0.32 "GET /compute/v2.1/servers/5a06904b-d932-4635-90df-b69dcb15d941" status: 404 len: 111 microversion: 2.1 time: 0.044642 May 30 12:05:16.054602 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 74/156] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:16 2022] GET /compute/v2.1/servers/5a06904b-d932-4635-90df-b69dcb15d941 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 30 12:05:16.116661 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-ef643e0c-0318-4721-95e4-66f466b7fd6b tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:16.117479 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-ef643e0c-0318-4721-95e4-66f466b7fd6b tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 8542b17d-0c65-4c5d-bc97-9d17545e2126] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:16.127347 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ef643e0c-0318-4721-95e4-66f466b7fd6b tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:16.127779 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ef643e0c-0318-4721-95e4-66f466b7fd6b tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:16.128579 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ef643e0c-0318-4721-95e4-66f466b7fd6b tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:16.129005 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ef643e0c-0318-4721-95e4-66f466b7fd6b tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:16.167967 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-49ae413c-434d-4bd8-bbcc-cd1e364c2f7f tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:16.169413 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-49ae413c-434d-4bd8-bbcc-cd1e364c2f7f tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] [instance: 5a06904b-d932-4635-90df-b69dcb15d941] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:16.185363 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-49ae413c-434d-4bd8-bbcc-cd1e364c2f7f tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:16.185834 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-49ae413c-434d-4bd8-bbcc-cd1e364c2f7f tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:16.186597 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-49ae413c-434d-4bd8-bbcc-cd1e364c2f7f tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:16.187033 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-49ae413c-434d-4bd8-bbcc-cd1e364c2f7f tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:16.201821 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.wsgi [None req-49ae413c-434d-4bd8-bbcc-cd1e364c2f7f tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] HTTP exception thrown: Instance 5a06904b-d932-4635-90df-b69dcb15d941 could not be found. May 30 12:05:16.203719 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-49ae413c-434d-4bd8-bbcc-cd1e364c2f7f tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Request method failure captured: May 30 12:05:16.203719 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: request: GET /compute/v2.1/servers/5a06904b-d932-4635-90df-b69dcb15d941/os-volume_attachments HTTP/1.1 May 30 12:05:16.203719 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Accept: application/json May 30 12:05:16.203719 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Accept-Encoding: identity May 30 12:05:16.203719 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Connection: close May 30 12:05:16.203719 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Content-Length: 0 May 30 12:05:16.203719 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Content-Type: application/json May 30 12:05:16.203719 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Host: 10.222.0.32 May 30 12:05:16.203719 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Openstack-System-Scope: None May 30 12:05:16.203719 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: User-Agent: python-urllib3/1.26.9 May 30 12:05:16.203719 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Auth-Token: gAAAAABilLK3iXHYpYWvSNGMawozRs1eyDVX6wioG6pSA_nTpBdwJ7dwTEgezoPz7jN-jdFudSR4DUsdqzPttdxfyQcWg9ah8pjARsIW-ZI5POywJ5Gc8y22dsxgqiwEDnUk79hfmt-pfcOaqtShNQZ2sSczAyz06KvLpjDR1UA1XsligXs_5Q8 May 30 12:05:16.203719 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Domain-Id: None May 30 12:05:16.203719 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Domain-Name: None May 30 12:05:16.203719 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Identity-Status: Confirmed May 30 12:05:16.203719 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Is-Admin-Project: True May 30 12:05:16.203719 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Domain-Id: default May 30 12:05:16.203719 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Domain-Name: Default May 30 12:05:16.203719 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Id: a60b241805384ef49352b3791cfd3d8c May 30 12:05:16.203719 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Name: tempest-DeleteServersTestJSON-1844435369 May 30 12:05:16.203719 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Role: reader,member May 30 12:05:16.203719 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Roles: reader,member May 30 12:05:16.205125 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/a60b241805384ef49352b3791cfd3d8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/a60b241805384ef49352b3791cfd3d8c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/a60b241805384ef49352b3791cfd3d8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_a60b241805384ef49352b3791cfd3d8c", "adminURL": "http://10.222.0.32:8080"}]}] May 30 12:05:16.205125 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant: tempest-DeleteServersTestJSON-1844435369 May 30 12:05:16.205125 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant-Id: a60b241805384ef49352b3791cfd3d8c May 30 12:05:16.205125 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant-Name: tempest-DeleteServersTestJSON-1844435369 May 30 12:05:16.205125 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User: tempest-DeleteServersTestJSON-1844435369-project May 30 12:05:16.205125 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Domain-Id: default May 30 12:05:16.205125 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Domain-Name: Default May 30 12:05:16.205125 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Id: e591526a8c3645de9c5965a40f8ef90a May 30 12:05:16.205125 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Name: tempest-DeleteServersTestJSON-1844435369-project May 30 12:05:16.205125 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: method: > May 30 12:05:16.205125 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: exception: Instance 5a06904b-d932-4635-90df-b69dcb15d941 could not be found. May 30 12:05:16.205125 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: action_args: {'server_id': '5a06904b-d932-4635-90df-b69dcb15d941'} May 30 12:05:16.205773 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:05:16.205773 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:05:16.205773 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:05:16.205773 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:05:16.205773 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:05:16.205773 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:05:16.205773 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:05:16.205773 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:05:16.205773 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:05:16.205773 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:05:16.205773 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a06904b-d932-4635-90df-b69dcb15d941 could not be found. May 30 12:05:16.205773 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:05:16.205773 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:05:16.205773 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:05:16.205773 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:05:16.205773 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:05:16.205773 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:05:16.205773 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:05:16.205773 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:05:16.205773 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:05:16.206965 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:05:16.206965 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 30 12:05:16.206965 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 30 12:05:16.206965 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 30 12:05:16.206965 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 30 12:05:16.206965 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 30 12:05:16.206965 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 30 12:05:16.206965 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:05:16.206965 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:05:16.206965 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a06904b-d932-4635-90df-b69dcb15d941 could not be found. May 30 12:05:16.206965 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:05:16.206965 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:05:16.206965 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:05:16.206965 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:05:16.206965 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:05:16.206965 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:05:16.206965 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:05:16.206965 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:05:16.206965 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a06904b-d932-4635-90df-b69dcb15d941 could not be found. May 30 12:05:16.206965 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:05:16.209111 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-49ae413c-434d-4bd8-bbcc-cd1e364c2f7f tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Returning 404 to user: Instance 5a06904b-d932-4635-90df-b69dcb15d941 could not be found. {{(pid=117670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:05:16.210631 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-49ae413c-434d-4bd8-bbcc-cd1e364c2f7f tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] 10.222.0.32 "GET /compute/v2.1/servers/5a06904b-d932-4635-90df-b69dcb15d941/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.046397 May 30 12:05:16.211300 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 75/157] 10.222.0.32 () {58 vars in 1301 bytes} [Mon May 30 12:05:16 2022] GET /compute/v2.1/servers/5a06904b-d932-4635-90df-b69dcb15d941/os-volume_attachments => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 30 12:05:16.275944 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-ef643e0c-0318-4721-95e4-66f466b7fd6b tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:16.286849 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-ef643e0c-0318-4721-95e4-66f466b7fd6b tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126" status: 200 len: 1521 microversion: 2.1 time: 0.174401 May 30 12:05:16.287327 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 83/158] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:16 2022] GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:05:17.304184 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-3004a3c4-8828-418f-a22f-25dffa8fedb8 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:17.304827 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-3004a3c4-8828-418f-a22f-25dffa8fedb8 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 8542b17d-0c65-4c5d-bc97-9d17545e2126] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:17.311848 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3004a3c4-8828-418f-a22f-25dffa8fedb8 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:17.312710 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3004a3c4-8828-418f-a22f-25dffa8fedb8 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:17.313507 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3004a3c4-8828-418f-a22f-25dffa8fedb8 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:17.313970 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3004a3c4-8828-418f-a22f-25dffa8fedb8 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:17.440375 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-df8e2607-934c-417a-b08f-680e37a670d7 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:17.440375 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-df8e2607-934c-417a-b08f-680e37a670d7 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] [instance: 5a06904b-d932-4635-90df-b69dcb15d941] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:17.457684 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-df8e2607-934c-417a-b08f-680e37a670d7 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:17.458430 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-df8e2607-934c-417a-b08f-680e37a670d7 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:17.459386 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-df8e2607-934c-417a-b08f-680e37a670d7 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:17.460016 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-df8e2607-934c-417a-b08f-680e37a670d7 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:17.465772 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-3004a3c4-8828-418f-a22f-25dffa8fedb8 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:17.474778 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-3004a3c4-8828-418f-a22f-25dffa8fedb8 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126" status: 200 len: 1521 microversion: 2.1 time: 0.174624 May 30 12:05:17.475366 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 76/159] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:17 2022] GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:05:17.477271 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.wsgi [None req-df8e2607-934c-417a-b08f-680e37a670d7 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] HTTP exception thrown: Instance 5a06904b-d932-4635-90df-b69dcb15d941 could not be found. May 30 12:05:17.481814 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-df8e2607-934c-417a-b08f-680e37a670d7 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Request method failure captured: May 30 12:05:17.481814 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: request: DELETE /compute/v2.1/servers/5a06904b-d932-4635-90df-b69dcb15d941 HTTP/1.1 May 30 12:05:17.481814 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Accept: application/json May 30 12:05:17.481814 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Accept-Encoding: identity May 30 12:05:17.481814 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Connection: close May 30 12:05:17.481814 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Content-Length: 0 May 30 12:05:17.481814 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Content-Type: application/json May 30 12:05:17.481814 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Host: 10.222.0.32 May 30 12:05:17.481814 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Openstack-System-Scope: None May 30 12:05:17.481814 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: User-Agent: python-urllib3/1.26.9 May 30 12:05:17.481814 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Auth-Token: gAAAAABilLK3iXHYpYWvSNGMawozRs1eyDVX6wioG6pSA_nTpBdwJ7dwTEgezoPz7jN-jdFudSR4DUsdqzPttdxfyQcWg9ah8pjARsIW-ZI5POywJ5Gc8y22dsxgqiwEDnUk79hfmt-pfcOaqtShNQZ2sSczAyz06KvLpjDR1UA1XsligXs_5Q8 May 30 12:05:17.481814 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Domain-Id: None May 30 12:05:17.481814 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Domain-Name: None May 30 12:05:17.481814 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Identity-Status: Confirmed May 30 12:05:17.481814 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Is-Admin-Project: True May 30 12:05:17.481814 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Domain-Id: default May 30 12:05:17.481814 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Domain-Name: Default May 30 12:05:17.481814 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Id: a60b241805384ef49352b3791cfd3d8c May 30 12:05:17.481814 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Name: tempest-DeleteServersTestJSON-1844435369 May 30 12:05:17.481814 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Role: reader,member May 30 12:05:17.481814 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Roles: reader,member May 30 12:05:17.483047 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/a60b241805384ef49352b3791cfd3d8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/a60b241805384ef49352b3791cfd3d8c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/a60b241805384ef49352b3791cfd3d8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_a60b241805384ef49352b3791cfd3d8c", "adminURL": "http://10.222.0.32:8080"}]}] May 30 12:05:17.483047 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Tenant: tempest-DeleteServersTestJSON-1844435369 May 30 12:05:17.483047 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Tenant-Id: a60b241805384ef49352b3791cfd3d8c May 30 12:05:17.483047 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Tenant-Name: tempest-DeleteServersTestJSON-1844435369 May 30 12:05:17.483047 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User: tempest-DeleteServersTestJSON-1844435369-project May 30 12:05:17.483047 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Domain-Id: default May 30 12:05:17.483047 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Domain-Name: Default May 30 12:05:17.483047 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Id: e591526a8c3645de9c5965a40f8ef90a May 30 12:05:17.483047 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Name: tempest-DeleteServersTestJSON-1844435369-project May 30 12:05:17.483047 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: method: > May 30 12:05:17.483047 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: exception: Instance 5a06904b-d932-4635-90df-b69dcb15d941 could not be found. May 30 12:05:17.483047 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: action_args: {'id': '5a06904b-d932-4635-90df-b69dcb15d941'} May 30 12:05:17.483697 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:05:17.483697 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:05:17.483697 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:05:17.483697 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:05:17.483697 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:05:17.483697 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:05:17.483697 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:05:17.483697 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:05:17.483697 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:05:17.483697 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:05:17.483697 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a06904b-d932-4635-90df-b69dcb15d941 could not be found. May 30 12:05:17.483697 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:05:17.483697 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:05:17.483697 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:05:17.483697 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:05:17.483697 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:05:17.483697 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:05:17.483697 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:05:17.483697 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:05:17.483697 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:05:17.485457 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:05:17.485457 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 30 12:05:17.485457 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 30 12:05:17.485457 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 30 12:05:17.485457 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 30 12:05:17.485457 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 30 12:05:17.485457 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 30 12:05:17.485457 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:05:17.485457 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:05:17.485457 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a06904b-d932-4635-90df-b69dcb15d941 could not be found. May 30 12:05:17.485457 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:05:17.485457 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:05:17.485457 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:05:17.485457 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:05:17.485457 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:05:17.485457 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:05:17.485457 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:05:17.485457 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:05:17.485457 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a06904b-d932-4635-90df-b69dcb15d941 could not be found. May 30 12:05:17.485457 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:05:17.486833 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-df8e2607-934c-417a-b08f-680e37a670d7 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Returning 404 to user: Instance 5a06904b-d932-4635-90df-b69dcb15d941 could not be found. {{(pid=117671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:05:17.486833 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-df8e2607-934c-417a-b08f-680e37a670d7 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] 10.222.0.32 "DELETE /compute/v2.1/servers/5a06904b-d932-4635-90df-b69dcb15d941" status: 404 len: 111 microversion: 2.1 time: 0.049744 May 30 12:05:17.486833 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 84/160] 10.222.0.32 () {58 vars in 1238 bytes} [Mon May 30 12:05:17 2022] DELETE /compute/v2.1/servers/5a06904b-d932-4635-90df-b69dcb15d941 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 30 12:05:17.492550 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-9cf6f7a5-0ea7-43da-9c2c-3b47647cf8c2 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:17.493173 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-9cf6f7a5-0ea7-43da-9c2c-3b47647cf8c2 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] [instance: 5a06904b-d932-4635-90df-b69dcb15d941] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:17.499440 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9cf6f7a5-0ea7-43da-9c2c-3b47647cf8c2 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:17.500782 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9cf6f7a5-0ea7-43da-9c2c-3b47647cf8c2 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:17.501592 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9cf6f7a5-0ea7-43da-9c2c-3b47647cf8c2 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:17.502040 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9cf6f7a5-0ea7-43da-9c2c-3b47647cf8c2 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:17.517981 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.wsgi [None req-9cf6f7a5-0ea7-43da-9c2c-3b47647cf8c2 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] HTTP exception thrown: Instance 5a06904b-d932-4635-90df-b69dcb15d941 could not be found. May 30 12:05:17.519544 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-9cf6f7a5-0ea7-43da-9c2c-3b47647cf8c2 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Request method failure captured: May 30 12:05:17.519544 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: request: GET /compute/v2.1/servers/5a06904b-d932-4635-90df-b69dcb15d941 HTTP/1.1 May 30 12:05:17.519544 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Accept: application/json May 30 12:05:17.519544 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Accept-Encoding: identity May 30 12:05:17.519544 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Connection: close May 30 12:05:17.519544 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Content-Length: 0 May 30 12:05:17.519544 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Content-Type: application/json May 30 12:05:17.519544 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Host: 10.222.0.32 May 30 12:05:17.519544 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Openstack-System-Scope: None May 30 12:05:17.519544 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: User-Agent: python-urllib3/1.26.9 May 30 12:05:17.519544 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Auth-Token: gAAAAABilLK3iXHYpYWvSNGMawozRs1eyDVX6wioG6pSA_nTpBdwJ7dwTEgezoPz7jN-jdFudSR4DUsdqzPttdxfyQcWg9ah8pjARsIW-ZI5POywJ5Gc8y22dsxgqiwEDnUk79hfmt-pfcOaqtShNQZ2sSczAyz06KvLpjDR1UA1XsligXs_5Q8 May 30 12:05:17.519544 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Domain-Id: None May 30 12:05:17.519544 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Domain-Name: None May 30 12:05:17.519544 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Identity-Status: Confirmed May 30 12:05:17.519544 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Is-Admin-Project: True May 30 12:05:17.519544 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Domain-Id: default May 30 12:05:17.519544 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Domain-Name: Default May 30 12:05:17.519544 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Id: a60b241805384ef49352b3791cfd3d8c May 30 12:05:17.519544 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Name: tempest-DeleteServersTestJSON-1844435369 May 30 12:05:17.519544 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Role: reader,member May 30 12:05:17.519544 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Roles: reader,member May 30 12:05:17.521049 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/a60b241805384ef49352b3791cfd3d8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/a60b241805384ef49352b3791cfd3d8c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/a60b241805384ef49352b3791cfd3d8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_a60b241805384ef49352b3791cfd3d8c", "adminURL": "http://10.222.0.32:8080"}]}] May 30 12:05:17.521049 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant: tempest-DeleteServersTestJSON-1844435369 May 30 12:05:17.521049 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant-Id: a60b241805384ef49352b3791cfd3d8c May 30 12:05:17.521049 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant-Name: tempest-DeleteServersTestJSON-1844435369 May 30 12:05:17.521049 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User: tempest-DeleteServersTestJSON-1844435369-project May 30 12:05:17.521049 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Domain-Id: default May 30 12:05:17.521049 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Domain-Name: Default May 30 12:05:17.521049 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Id: e591526a8c3645de9c5965a40f8ef90a May 30 12:05:17.521049 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Name: tempest-DeleteServersTestJSON-1844435369-project May 30 12:05:17.521049 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: method: > May 30 12:05:17.521049 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: exception: Instance 5a06904b-d932-4635-90df-b69dcb15d941 could not be found. May 30 12:05:17.521049 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: action_args: {'id': '5a06904b-d932-4635-90df-b69dcb15d941'} May 30 12:05:17.521767 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:05:17.521767 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:05:17.521767 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:05:17.521767 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:05:17.521767 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:05:17.521767 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:05:17.521767 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:05:17.521767 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:05:17.521767 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:05:17.521767 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:05:17.521767 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a06904b-d932-4635-90df-b69dcb15d941 could not be found. May 30 12:05:17.521767 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:05:17.521767 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:05:17.521767 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:05:17.521767 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:05:17.521767 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:05:17.521767 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:05:17.521767 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:05:17.521767 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:05:17.521767 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:05:17.522817 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:05:17.522817 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 30 12:05:17.522817 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 30 12:05:17.522817 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 30 12:05:17.522817 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 30 12:05:17.522817 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:05:17.522817 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:05:17.522817 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a06904b-d932-4635-90df-b69dcb15d941 could not be found. May 30 12:05:17.522817 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:05:17.522817 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:05:17.522817 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:05:17.522817 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:05:17.522817 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:05:17.522817 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:05:17.522817 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:05:17.522817 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:05:17.522817 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a06904b-d932-4635-90df-b69dcb15d941 could not be found. May 30 12:05:17.522817 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:05:17.523750 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-9cf6f7a5-0ea7-43da-9c2c-3b47647cf8c2 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] Returning 404 to user: Instance 5a06904b-d932-4635-90df-b69dcb15d941 could not be found. {{(pid=117670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:05:17.523750 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-9cf6f7a5-0ea7-43da-9c2c-3b47647cf8c2 tempest-DeleteServersTestJSON-1844435369 tempest-DeleteServersTestJSON-1844435369-project] 10.222.0.32 "GET /compute/v2.1/servers/5a06904b-d932-4635-90df-b69dcb15d941" status: 404 len: 111 microversion: 2.1 time: 0.033374 May 30 12:05:17.523750 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 77/161] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:17 2022] GET /compute/v2.1/servers/5a06904b-d932-4635-90df-b69dcb15d941 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 30 12:05:18.491591 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-19a13142-a739-4f86-9a48-c481e550add1 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:18.492841 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-19a13142-a739-4f86-9a48-c481e550add1 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 8542b17d-0c65-4c5d-bc97-9d17545e2126] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:18.501791 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-19a13142-a739-4f86-9a48-c481e550add1 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:18.502622 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-19a13142-a739-4f86-9a48-c481e550add1 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:18.503642 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-19a13142-a739-4f86-9a48-c481e550add1 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:18.504479 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-19a13142-a739-4f86-9a48-c481e550add1 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:18.727464 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-19a13142-a739-4f86-9a48-c481e550add1 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:18.743335 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-19a13142-a739-4f86-9a48-c481e550add1 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126" status: 200 len: 1521 microversion: 2.1 time: 0.255625 May 30 12:05:18.753474 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 85/162] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:18 2022] GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126 => generated 1521 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:05:19.761363 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-e4767a99-8ca5-47ae-98e4-38b575cca0e9 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:19.762063 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-e4767a99-8ca5-47ae-98e4-38b575cca0e9 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 8542b17d-0c65-4c5d-bc97-9d17545e2126] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:19.772998 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e4767a99-8ca5-47ae-98e4-38b575cca0e9 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:19.773704 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e4767a99-8ca5-47ae-98e4-38b575cca0e9 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:19.774754 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e4767a99-8ca5-47ae-98e4-38b575cca0e9 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:19.775536 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e4767a99-8ca5-47ae-98e4-38b575cca0e9 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:19.931109 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-e4767a99-8ca5-47ae-98e4-38b575cca0e9 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:19.940439 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-e4767a99-8ca5-47ae-98e4-38b575cca0e9 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126" status: 200 len: 1521 microversion: 2.1 time: 0.183328 May 30 12:05:19.941211 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 78/163] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:19 2022] GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:05:20.293572 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-92622fe5-fb99-4451-a716-cc46546b2d81 tempest-VolumesSnapshotsTestJSON-132726790 tempest-VolumesSnapshotsTestJSON-132726790-project] Action: 'create', calling method: .version_select at 0x7f0ef89a61f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1003274746"}} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:05:20.709136 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-92622fe5-fb99-4451-a716-cc46546b2d81 tempest-VolumesSnapshotsTestJSON-132726790 tempest-VolumesSnapshotsTestJSON-132726790-project] 10.222.0.32 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.708179 May 30 12:05:20.715505 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 86/164] 10.222.0.32 () {60 vars in 1154 bytes} [Mon May 30 12:05:19 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 711 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 30 12:05:20.721060 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-0413efa4-2563-4278-acab-d4c6a2ce1c05 tempest-VolumesSnapshotsTestJSON-132726790 tempest-VolumesSnapshotsTestJSON-132726790-project] Calling method '.version_select at 0x7f0ef898eb80>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:20.788509 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-0413efa4-2563-4278-acab-d4c6a2ce1c05 tempest-VolumesSnapshotsTestJSON-132726790 tempest-VolumesSnapshotsTestJSON-132726790-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/61ffe87f-b76e-4b99-96e6-54377c7e4173" status: 200 len: 345 microversion: 2.1 time: 0.071560 May 30 12:05:20.789246 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 79/165] 10.222.0.32 () {58 vars in 1244 bytes} [Mon May 30 12:05:20 2022] GET /compute/v2.1/os-volumes/61ffe87f-b76e-4b99-96e6-54377c7e4173 => generated 345 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:05:20.957323 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-44d16e50-a361-4a8e-8052-9806366bc34d tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:20.958311 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-44d16e50-a361-4a8e-8052-9806366bc34d tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 8542b17d-0c65-4c5d-bc97-9d17545e2126] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:20.967432 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-44d16e50-a361-4a8e-8052-9806366bc34d tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:20.967887 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-44d16e50-a361-4a8e-8052-9806366bc34d tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:20.969224 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-44d16e50-a361-4a8e-8052-9806366bc34d tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:20.969840 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-44d16e50-a361-4a8e-8052-9806366bc34d tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:21.187766 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-44d16e50-a361-4a8e-8052-9806366bc34d tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:21.200785 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-44d16e50-a361-4a8e-8052-9806366bc34d tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126" status: 200 len: 1521 microversion: 2.1 time: 0.247372 May 30 12:05:21.201802 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 87/166] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:20 2022] GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126 => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:05:21.804104 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-129c0b5d-654c-4bcf-9a17-5489354c0163 tempest-VolumesSnapshotsTestJSON-132726790 tempest-VolumesSnapshotsTestJSON-132726790-project] Calling method '.version_select at 0x7f0ef89885e0>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:21.852267 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-129c0b5d-654c-4bcf-9a17-5489354c0163 tempest-VolumesSnapshotsTestJSON-132726790 tempest-VolumesSnapshotsTestJSON-132726790-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/61ffe87f-b76e-4b99-96e6-54377c7e4173" status: 200 len: 346 microversion: 2.1 time: 0.052428 May 30 12:05:21.852910 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 80/167] 10.222.0.32 () {58 vars in 1244 bytes} [Mon May 30 12:05:21 2022] GET /compute/v2.1/os-volumes/61ffe87f-b76e-4b99-96e6-54377c7e4173 => generated 346 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:05:21.865006 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-57b0897c-82b7-44f2-92ea-19627d18ad1e tempest-VolumesSnapshotsTestJSON-132726790 tempest-VolumesSnapshotsTestJSON-132726790-project] Action: 'create', calling method: .version_select at 0x7f0ef8987d30>, body: {"snapshot": {"volume_id": "61ffe87f-b76e-4b99-96e6-54377c7e4173", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-673321128"}} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:05:22.024255 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-57b0897c-82b7-44f2-92ea-19627d18ad1e tempest-VolumesSnapshotsTestJSON-132726790 tempest-VolumesSnapshotsTestJSON-132726790-project] 10.222.0.32 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.163266 May 30 12:05:22.024900 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 88/168] 10.222.0.32 () {60 vars in 1161 bytes} [Mon May 30 12:05:21 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 30 12:05:22.036891 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-1d09b580-5834-4f29-afe6-a28c3fa8791c tempest-VolumesSnapshotsTestJSON-132726790 tempest-VolumesSnapshotsTestJSON-132726790-project] Calling method '.version_select at 0x7f0ef89f3dc0>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:22.071971 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-1d09b580-5834-4f29-afe6-a28c3fa8791c tempest-VolumesSnapshotsTestJSON-132726790 tempest-VolumesSnapshotsTestJSON-132726790-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/61ff91f1-c3ee-4aef-aa0e-162e0ca8743e" status: 200 len: 286 microversion: 2.1 time: 0.040519 May 30 12:05:22.072706 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 81/169] 10.222.0.32 () {58 vars in 1250 bytes} [Mon May 30 12:05:22 2022] GET /compute/v2.1/os-snapshots/61ff91f1-c3ee-4aef-aa0e-162e0ca8743e => generated 286 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:05:22.083265 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-91bf4c98-a410-4a5a-94eb-7db6a0815bbe tempest-VolumesSnapshotsTestJSON-132726790 tempest-VolumesSnapshotsTestJSON-132726790-project] Calling method '.version_select at 0x7f0ef89a6430>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:22.124057 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-91bf4c98-a410-4a5a-94eb-7db6a0815bbe tempest-VolumesSnapshotsTestJSON-132726790 tempest-VolumesSnapshotsTestJSON-132726790-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.044636 May 30 12:05:22.125549 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 89/170] 10.222.0.32 () {58 vars in 1139 bytes} [Mon May 30 12:05:22 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:05:22.135865 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-697c4002-3a0b-46c4-a6ee-b3b5185a46e9 tempest-VolumesSnapshotsTestJSON-132726790 tempest-VolumesSnapshotsTestJSON-132726790-project] Calling method '.version_select at 0x7f0ef89f3670>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:22.167809 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-697c4002-3a0b-46c4-a6ee-b3b5185a46e9 tempest-VolumesSnapshotsTestJSON-132726790 tempest-VolumesSnapshotsTestJSON-132726790-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/61ff91f1-c3ee-4aef-aa0e-162e0ca8743e" status: 200 len: 286 microversion: 2.1 time: 0.035780 May 30 12:05:22.168565 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 82/171] 10.222.0.32 () {58 vars in 1250 bytes} [Mon May 30 12:05:22 2022] GET /compute/v2.1/os-snapshots/61ff91f1-c3ee-4aef-aa0e-162e0ca8743e => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:05:22.219287 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-9598276b-69d8-4663-86fd-210f65c0bb58 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:22.220764 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-9598276b-69d8-4663-86fd-210f65c0bb58 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 8542b17d-0c65-4c5d-bc97-9d17545e2126] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:22.228824 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9598276b-69d8-4663-86fd-210f65c0bb58 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:22.229272 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9598276b-69d8-4663-86fd-210f65c0bb58 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:22.231577 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9598276b-69d8-4663-86fd-210f65c0bb58 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:22.232152 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9598276b-69d8-4663-86fd-210f65c0bb58 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:22.249260 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:05:22.383213 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-9598276b-69d8-4663-86fd-210f65c0bb58 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:22.391241 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-9598276b-69d8-4663-86fd-210f65c0bb58 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126" status: 200 len: 1521 microversion: 2.1 time: 0.175735 May 30 12:05:22.391778 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 90/172] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:22 2022] GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:05:22.849228 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-a4a86f10-aa14-4337-8cac-5d67c23be535 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-571685030", "imageRef": "b8ef93ed-af98-4d8c-9e1d-43d7b1f2b832", "flavorRef": "452", "networks": [{"uuid": "d20fda1c-0652-4fa5-b0ab-44f416d9d703"}]}} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:05:22.856221 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_api:SELECT=72 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:05:22.903372 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.network.neutron [None req-a4a86f10-aa14-4337-8cac-5d67c23be535 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] validate_networks() for [('d20fda1c-0652-4fa5-b0ab-44f416d9d703', None, None, None, None, None)] {{(pid=117670) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 30 12:05:23.180834 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-fff2dc38-1376-4e99-8027-35bba07ae77b tempest-VolumesSnapshotsTestJSON-132726790 tempest-VolumesSnapshotsTestJSON-132726790-project] Calling method '.version_select at 0x7f0ef8987e50>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:23.210951 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-fff2dc38-1376-4e99-8027-35bba07ae77b tempest-VolumesSnapshotsTestJSON-132726790 tempest-VolumesSnapshotsTestJSON-132726790-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/61ff91f1-c3ee-4aef-aa0e-162e0ca8743e" status: 200 len: 286 microversion: 2.1 time: 0.033758 May 30 12:05:23.211523 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 91/173] 10.222.0.32 () {58 vars in 1250 bytes} [Mon May 30 12:05:23 2022] GET /compute/v2.1/os-snapshots/61ff91f1-c3ee-4aef-aa0e-162e0ca8743e => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 30 12:05:23.290587 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-a4a86f10-aa14-4337-8cac-5d67c23be535 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Flavor limits 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 30 12:05:23.291012 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-a4a86f10-aa14-4337-8cac-5d67c23be535 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Image limits 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 30 12:05:23.291495 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-a4a86f10-aa14-4337-8cac-5d67c23be535 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Flavor pref 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 30 12:05:23.291905 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-a4a86f10-aa14-4337-8cac-5d67c23be535 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Image pref 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 30 12:05:23.292356 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-a4a86f10-aa14-4337-8cac-5d67c23be535 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 30 12:05:23.302210 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a4a86f10-aa14-4337-8cac-5d67c23be535 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:23.302656 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a4a86f10-aa14-4337-8cac-5d67c23be535 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:23.303858 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a4a86f10-aa14-4337-8cac-5d67c23be535 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:23.303973 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a4a86f10-aa14-4337-8cac-5d67c23be535 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:23.324429 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.quota [None req-a4a86f10-aa14-4337-8cac-5d67c23be535 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Getting quotas for project b7843d3fb7cb402b8a85179da7bfffaa. Resources: {'cores', 'instances', 'ram'} {{(pid=117670) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 30 12:05:23.330412 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.quota [None req-a4a86f10-aa14-4337-8cac-5d67c23be535 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Getting quotas for user a440b40bc3124bafa502f66a004d0de0 and project b7843d3fb7cb402b8a85179da7bfffaa. Resources: {'cores', 'instances', 'ram'} {{(pid=117670) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 30 12:05:23.345469 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-a4a86f10-aa14-4337-8cac-5d67c23be535 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Going to run 1 instances... {{(pid=117670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 30 12:05:23.348105 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-a4a86f10-aa14-4337-8cac-5d67c23be535 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] [instance: cdfbd2ce-7401-4bde-9410-9ea55f87512d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b8ef93ed-af98-4d8c-9e1d-43d7b1f2b832',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 30 12:05:23.402514 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-a4a86f10-aa14-4337-8cac-5d67c23be535 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.556412 May 30 12:05:23.402514 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 83/174] 10.222.0.32 () {60 vars in 1146 bytes} [Mon May 30 12:05:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 558 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 30 12:05:23.408547 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-0af0d102-ac9a-4361-8a93-8d982c29d9d5 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:23.409639 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-0af0d102-ac9a-4361-8a93-8d982c29d9d5 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 8542b17d-0c65-4c5d-bc97-9d17545e2126] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:23.412444 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-cdaedac9-c896-4059-b424-c3c250681525 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:23.413323 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-cdaedac9-c896-4059-b424-c3c250681525 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] [instance: cdfbd2ce-7401-4bde-9410-9ea55f87512d] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:23.416057 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:05:23.417863 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0af0d102-ac9a-4361-8a93-8d982c29d9d5 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:23.430566 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0af0d102-ac9a-4361-8a93-8d982c29d9d5 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:23.432535 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0af0d102-ac9a-4361-8a93-8d982c29d9d5 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:23.433195 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0af0d102-ac9a-4361-8a93-8d982c29d9d5 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:23.490384 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-cdaedac9-c896-4059-b424-c3c250681525 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a440b40bc3124bafa502f66a004d0de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7843d3fb7cb402b8a85179da7bfffaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:23.497287 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-cdaedac9-c896-4059-b424-c3c250681525 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] 10.222.0.32 "GET /compute/v2.1/servers/cdfbd2ce-7401-4bde-9410-9ea55f87512d" status: 200 len: 1213 microversion: 2.1 time: 0.088615 May 30 12:05:23.497856 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 84/175] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:23 2022] GET /compute/v2.1/servers/cdfbd2ce-7401-4bde-9410-9ea55f87512d => generated 1213 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:05:23.621147 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-0af0d102-ac9a-4361-8a93-8d982c29d9d5 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:23.629376 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-0af0d102-ac9a-4361-8a93-8d982c29d9d5 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126" status: 200 len: 1521 microversion: 2.1 time: 0.225152 May 30 12:05:23.638524 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 92/176] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:23 2022] GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126 => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:05:24.222951 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-e3f37298-2df6-472f-8367-cf33d6603964 tempest-VolumesSnapshotsTestJSON-132726790 tempest-VolumesSnapshotsTestJSON-132726790-project] Calling method '.version_select at 0x7f0ef898ef70>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:24.254242 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-e3f37298-2df6-472f-8367-cf33d6603964 tempest-VolumesSnapshotsTestJSON-132726790 tempest-VolumesSnapshotsTestJSON-132726790-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/61ff91f1-c3ee-4aef-aa0e-162e0ca8743e" status: 200 len: 286 microversion: 2.1 time: 0.035665 May 30 12:05:24.254824 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 85/177] 10.222.0.32 () {58 vars in 1250 bytes} [Mon May 30 12:05:24 2022] GET /compute/v2.1/os-snapshots/61ff91f1-c3ee-4aef-aa0e-162e0ca8743e => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:05:24.515693 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-324d3f80-85fc-4a14-955e-db81e957a7e3 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:24.516350 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-324d3f80-85fc-4a14-955e-db81e957a7e3 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] [instance: cdfbd2ce-7401-4bde-9410-9ea55f87512d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:24.523634 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-324d3f80-85fc-4a14-955e-db81e957a7e3 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:24.524081 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-324d3f80-85fc-4a14-955e-db81e957a7e3 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:24.524905 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-324d3f80-85fc-4a14-955e-db81e957a7e3 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:24.525342 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-324d3f80-85fc-4a14-955e-db81e957a7e3 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:24.601806 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-324d3f80-85fc-4a14-955e-db81e957a7e3 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a440b40bc3124bafa502f66a004d0de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7843d3fb7cb402b8a85179da7bfffaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:24.609392 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-324d3f80-85fc-4a14-955e-db81e957a7e3 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] 10.222.0.32 "GET /compute/v2.1/servers/cdfbd2ce-7401-4bde-9410-9ea55f87512d" status: 200 len: 1217 microversion: 2.1 time: 0.098377 May 30 12:05:24.610076 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 93/178] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:24 2022] GET /compute/v2.1/servers/cdfbd2ce-7401-4bde-9410-9ea55f87512d => generated 1217 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:05:24.646760 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-475622bc-45dd-4e36-8cf3-c9e2a459cd29 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:24.647384 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-475622bc-45dd-4e36-8cf3-c9e2a459cd29 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 8542b17d-0c65-4c5d-bc97-9d17545e2126] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:24.653720 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-475622bc-45dd-4e36-8cf3-c9e2a459cd29 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:24.654177 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-475622bc-45dd-4e36-8cf3-c9e2a459cd29 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:24.654955 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-475622bc-45dd-4e36-8cf3-c9e2a459cd29 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:24.655390 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-475622bc-45dd-4e36-8cf3-c9e2a459cd29 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:24.794446 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-475622bc-45dd-4e36-8cf3-c9e2a459cd29 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:24.802693 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-475622bc-45dd-4e36-8cf3-c9e2a459cd29 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126" status: 200 len: 1521 microversion: 2.1 time: 0.159923 May 30 12:05:24.803090 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 86/179] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:24 2022] GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:05:25.266507 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-b3aaf1fa-c3a9-4cee-a000-9db2c0cf9169 tempest-VolumesSnapshotsTestJSON-132726790 tempest-VolumesSnapshotsTestJSON-132726790-project] Calling method '.version_select at 0x7f0ef89a6f70>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:25.301212 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-b3aaf1fa-c3a9-4cee-a000-9db2c0cf9169 tempest-VolumesSnapshotsTestJSON-132726790 tempest-VolumesSnapshotsTestJSON-132726790-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/61ff91f1-c3ee-4aef-aa0e-162e0ca8743e" status: 200 len: 286 microversion: 2.1 time: 0.038935 May 30 12:05:25.301942 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 94/180] 10.222.0.32 () {58 vars in 1250 bytes} [Mon May 30 12:05:25 2022] GET /compute/v2.1/os-snapshots/61ff91f1-c3ee-4aef-aa0e-162e0ca8743e => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:05:25.627234 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-db595712-1166-4761-ab66-1ca7635301c0 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:25.627848 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-db595712-1166-4761-ab66-1ca7635301c0 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] [instance: cdfbd2ce-7401-4bde-9410-9ea55f87512d] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:25.634382 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-db595712-1166-4761-ab66-1ca7635301c0 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:25.634836 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-db595712-1166-4761-ab66-1ca7635301c0 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:25.635636 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-db595712-1166-4761-ab66-1ca7635301c0 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:25.636076 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-db595712-1166-4761-ab66-1ca7635301c0 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:25.700471 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-db595712-1166-4761-ab66-1ca7635301c0 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a440b40bc3124bafa502f66a004d0de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7843d3fb7cb402b8a85179da7bfffaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:25.708853 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-db595712-1166-4761-ab66-1ca7635301c0 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] 10.222.0.32 "GET /compute/v2.1/servers/cdfbd2ce-7401-4bde-9410-9ea55f87512d" status: 200 len: 1265 microversion: 2.1 time: 0.086000 May 30 12:05:25.709431 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 87/181] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:25 2022] GET /compute/v2.1/servers/cdfbd2ce-7401-4bde-9410-9ea55f87512d => generated 1265 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:05:25.818859 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-b79c6ebf-860d-4204-ba25-dcb06ee91f01 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:25.819470 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-b79c6ebf-860d-4204-ba25-dcb06ee91f01 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 8542b17d-0c65-4c5d-bc97-9d17545e2126] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:25.825914 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b79c6ebf-860d-4204-ba25-dcb06ee91f01 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:25.826354 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b79c6ebf-860d-4204-ba25-dcb06ee91f01 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:25.827315 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b79c6ebf-860d-4204-ba25-dcb06ee91f01 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:25.828309 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b79c6ebf-860d-4204-ba25-dcb06ee91f01 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:25.972330 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-b79c6ebf-860d-4204-ba25-dcb06ee91f01 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:25.981813 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-b79c6ebf-860d-4204-ba25-dcb06ee91f01 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126" status: 200 len: 1521 microversion: 2.1 time: 0.166595 May 30 12:05:25.982642 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 95/182] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:25 2022] GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:05:26.314860 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-706770da-81da-4f22-b078-945c129bc3b5 tempest-VolumesSnapshotsTestJSON-132726790 tempest-VolumesSnapshotsTestJSON-132726790-project] Calling method '.version_select at 0x7f0ef8a81820>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:26.353662 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-706770da-81da-4f22-b078-945c129bc3b5 tempest-VolumesSnapshotsTestJSON-132726790 tempest-VolumesSnapshotsTestJSON-132726790-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/61ff91f1-c3ee-4aef-aa0e-162e0ca8743e" status: 200 len: 287 microversion: 2.1 time: 0.043770 May 30 12:05:26.355143 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 88/183] 10.222.0.32 () {58 vars in 1250 bytes} [Mon May 30 12:05:26 2022] GET /compute/v2.1/os-snapshots/61ff91f1-c3ee-4aef-aa0e-162e0ca8743e => generated 287 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 30 12:05:26.365667 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-4653ab04-fe3b-4901-b094-d846e4a1efe2 tempest-VolumesSnapshotsTestJSON-132726790 tempest-VolumesSnapshotsTestJSON-132726790-project] Calling method '.version_select at 0x7f0ef8987ca0>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:26.430971 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-4653ab04-fe3b-4901-b094-d846e4a1efe2 tempest-VolumesSnapshotsTestJSON-132726790 tempest-VolumesSnapshotsTestJSON-132726790-project] 10.222.0.32 "DELETE /compute/v2.1/os-snapshots/61ff91f1-c3ee-4aef-aa0e-162e0ca8743e" status: 202 len: 0 microversion: 2.1 time: 0.068793 May 30 12:05:26.431147 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 96/184] 10.222.0.32 () {58 vars in 1253 bytes} [Mon May 30 12:05:26 2022] DELETE /compute/v2.1/os-snapshots/61ff91f1-c3ee-4aef-aa0e-162e0ca8743e => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 30 12:05:26.441257 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-9acd04fc-5dd1-44a2-9dde-3dc608146f11 tempest-VolumesSnapshotsTestJSON-132726790 tempest-VolumesSnapshotsTestJSON-132726790-project] Calling method '.version_select at 0x7f0ef8acbe50>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:26.475225 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-9acd04fc-5dd1-44a2-9dde-3dc608146f11 tempest-VolumesSnapshotsTestJSON-132726790 tempest-VolumesSnapshotsTestJSON-132726790-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/61ff91f1-c3ee-4aef-aa0e-162e0ca8743e" status: 200 len: 286 microversion: 2.1 time: 0.039818 May 30 12:05:26.475793 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 89/185] 10.222.0.32 () {58 vars in 1250 bytes} [Mon May 30 12:05:26 2022] GET /compute/v2.1/os-snapshots/61ff91f1-c3ee-4aef-aa0e-162e0ca8743e => generated 286 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:05:26.726718 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-d2a22cf6-e50b-4d65-ab2e-59e696542a26 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:26.727335 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-d2a22cf6-e50b-4d65-ab2e-59e696542a26 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] [instance: cdfbd2ce-7401-4bde-9410-9ea55f87512d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:26.734048 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d2a22cf6-e50b-4d65-ab2e-59e696542a26 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:26.734693 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d2a22cf6-e50b-4d65-ab2e-59e696542a26 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:26.735636 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d2a22cf6-e50b-4d65-ab2e-59e696542a26 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:26.736261 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d2a22cf6-e50b-4d65-ab2e-59e696542a26 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:26.888819 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-d2a22cf6-e50b-4d65-ab2e-59e696542a26 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a440b40bc3124bafa502f66a004d0de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7843d3fb7cb402b8a85179da7bfffaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:26.898775 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-d2a22cf6-e50b-4d65-ab2e-59e696542a26 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] 10.222.0.32 "GET /compute/v2.1/servers/cdfbd2ce-7401-4bde-9410-9ea55f87512d" status: 200 len: 1313 microversion: 2.1 time: 0.175800 May 30 12:05:26.899460 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 97/186] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:26 2022] GET /compute/v2.1/servers/cdfbd2ce-7401-4bde-9410-9ea55f87512d => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:05:27.003593 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-9df2a2f6-fa69-4677-8714-a80964b97785 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:27.005539 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-9df2a2f6-fa69-4677-8714-a80964b97785 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 8542b17d-0c65-4c5d-bc97-9d17545e2126] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:27.016412 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9df2a2f6-fa69-4677-8714-a80964b97785 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:27.017336 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9df2a2f6-fa69-4677-8714-a80964b97785 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:27.018202 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9df2a2f6-fa69-4677-8714-a80964b97785 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:27.018733 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9df2a2f6-fa69-4677-8714-a80964b97785 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:27.161542 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-9df2a2f6-fa69-4677-8714-a80964b97785 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:27.168990 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-9df2a2f6-fa69-4677-8714-a80964b97785 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126" status: 200 len: 1521 microversion: 2.1 time: 0.173068 May 30 12:05:27.179486 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 90/187] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:26 2022] GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:05:27.221892 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-4a24e2de-7dae-48e7-937b-72edcf330cf7 req-737fb181-1b68-4986-98f9-2a9fca9bc93f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdfbd2ce-7401-4bde-9410-9ea55f87512d", "tag": "84c3ed34-6a52-4ea0-a521-fc8b43d9a88d"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:05:27.230949 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-4a24e2de-7dae-48e7-937b-72edcf330cf7 req-737fb181-1b68-4986-98f9-2a9fca9bc93f service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:27.232085 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-4a24e2de-7dae-48e7-937b-72edcf330cf7 req-737fb181-1b68-4986-98f9-2a9fca9bc93f service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:27.247611 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-4a24e2de-7dae-48e7-937b-72edcf330cf7 req-737fb181-1b68-4986-98f9-2a9fca9bc93f service nova] Creating event network-changed:84c3ed34-6a52-4ea0-a521-fc8b43d9a88d for instance cdfbd2ce-7401-4bde-9410-9ea55f87512d on hv-cinder-84051 May 30 12:05:27.253232 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-4a24e2de-7dae-48e7-937b-72edcf330cf7 req-737fb181-1b68-4986-98f9-2a9fca9bc93f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036745 May 30 12:05:27.254039 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 98/188] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:05:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:05:27.486907 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-4814cb9c-ca5d-4d95-a908-eaf9b1aba4bd tempest-VolumesSnapshotsTestJSON-132726790 tempest-VolumesSnapshotsTestJSON-132726790-project] Calling method '.version_select at 0x7f0ef8a81700>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:27.521510 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.wsgi [None req-4814cb9c-ca5d-4d95-a908-eaf9b1aba4bd tempest-VolumesSnapshotsTestJSON-132726790 tempest-VolumesSnapshotsTestJSON-132726790-project] HTTP exception thrown: Snapshot 61ff91f1-c3ee-4aef-aa0e-162e0ca8743e could not be found. May 30 12:05:27.524181 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-4814cb9c-ca5d-4d95-a908-eaf9b1aba4bd tempest-VolumesSnapshotsTestJSON-132726790 tempest-VolumesSnapshotsTestJSON-132726790-project] Request method failure captured: May 30 12:05:27.524181 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: request: GET /compute/v2.1/os-snapshots/61ff91f1-c3ee-4aef-aa0e-162e0ca8743e HTTP/1.1 May 30 12:05:27.524181 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Accept: application/json May 30 12:05:27.524181 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Accept-Encoding: identity May 30 12:05:27.524181 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Connection: close May 30 12:05:27.524181 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Content-Length: 0 May 30 12:05:27.524181 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Content-Type: application/json May 30 12:05:27.524181 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Host: 10.222.0.32 May 30 12:05:27.524181 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Openstack-System-Scope: None May 30 12:05:27.524181 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: User-Agent: python-urllib3/1.26.9 May 30 12:05:27.524181 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Auth-Token: gAAAAABilLL_nYoV7ivIs5gzHVXl6tv3hzKlCqbYtTnsLXCfL27LMaJdkZGdlE1dw-oTMojro0XMAzAuAX7l6UPeKgHIMTCOyMZffjWhAQ82mKRPh7FgJJD1TLUOamm30d6AzFqrbpdVt7jTcUCj168vUrw09EGHc3u31iYbkZkR5JZGjuJJydo May 30 12:05:27.524181 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Domain-Id: None May 30 12:05:27.524181 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Domain-Name: None May 30 12:05:27.524181 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Identity-Status: Confirmed May 30 12:05:27.524181 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Is-Admin-Project: True May 30 12:05:27.524181 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Domain-Id: default May 30 12:05:27.524181 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Domain-Name: Default May 30 12:05:27.524181 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Id: e7b01b4dbe234da4abb82077d84bb238 May 30 12:05:27.524181 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-132726790 May 30 12:05:27.524181 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Role: reader,member May 30 12:05:27.524181 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Roles: reader,member May 30 12:05:27.525621 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/e7b01b4dbe234da4abb82077d84bb238"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/e7b01b4dbe234da4abb82077d84bb238"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/e7b01b4dbe234da4abb82077d84bb238"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_e7b01b4dbe234da4abb82077d84bb238", "adminURL": "http://10.222.0.32:8080"}]}] May 30 12:05:27.525621 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant: tempest-VolumesSnapshotsTestJSON-132726790 May 30 12:05:27.525621 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant-Id: e7b01b4dbe234da4abb82077d84bb238 May 30 12:05:27.525621 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-132726790 May 30 12:05:27.525621 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User: tempest-VolumesSnapshotsTestJSON-132726790-project May 30 12:05:27.525621 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Domain-Id: default May 30 12:05:27.525621 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Domain-Name: Default May 30 12:05:27.525621 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Id: 8cba74531efe4959ad40e0390f1609aa May 30 12:05:27.525621 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Name: tempest-VolumesSnapshotsTestJSON-132726790-project May 30 12:05:27.525621 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: method: May 30 12:05:27.525621 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: exception: Snapshot 61ff91f1-c3ee-4aef-aa0e-162e0ca8743e could not be found. May 30 12:05:27.525621 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: action_args: {'id': '61ff91f1-c3ee-4aef-aa0e-162e0ca8743e'} May 30 12:05:27.525621 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:05:27.526513 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:05:27.526513 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 30 12:05:27.526513 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 30 12:05:27.526513 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 30 12:05:27.526513 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 30 12:05:27.526513 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 30 12:05:27.526513 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 30 12:05:27.526513 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 30 12:05:27.526513 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 30 12:05:27.526513 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 30 12:05:27.526513 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 30 12:05:27.526513 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 30 12:05:27.526513 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 30 12:05:27.526513 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 30 12:05:27.526513 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 30 12:05:27.526513 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 61ff91f1-c3ee-4aef-aa0e-162e0ca8743e could not be found. (HTTP 404) (Request-ID: req-8ba615a4-c0eb-4bcd-b53c-dcaabc7c5a81) May 30 12:05:27.526513 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:05:27.526513 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:05:27.527747 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:05:27.527747 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:05:27.527747 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 30 12:05:27.527747 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 30 12:05:27.527747 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 30 12:05:27.527747 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 30 12:05:27.527747 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 30 12:05:27.527747 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 30 12:05:27.527747 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 30 12:05:27.527747 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 30 12:05:27.527747 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 30 12:05:27.527747 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 30 12:05:27.527747 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 30 12:05:27.527747 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 30 12:05:27.527747 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 30 12:05:27.527747 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 30 12:05:27.527747 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 30 12:05:27.527747 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 30 12:05:27.527747 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 30 12:05:27.528948 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 30 12:05:27.528948 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 30 12:05:27.528948 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 30 12:05:27.528948 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 30 12:05:27.528948 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 30 12:05:27.528948 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 61ff91f1-c3ee-4aef-aa0e-162e0ca8743e could not be found. May 30 12:05:27.528948 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:05:27.528948 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:05:27.528948 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:05:27.528948 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:05:27.528948 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:05:27.528948 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:05:27.528948 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:05:27.528948 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:05:27.528948 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 30 12:05:27.528948 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 30 12:05:27.528948 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:05:27.528948 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:05:27.528948 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 30 12:05:27.528948 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:05:27.530014 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 61ff91f1-c3ee-4aef-aa0e-162e0ca8743e could not be found. May 30 12:05:27.530014 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:05:27.530014 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:05:27.530014 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:05:27.530014 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:05:27.530014 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:05:27.530014 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:05:27.530014 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:05:27.530014 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:05:27.530014 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 61ff91f1-c3ee-4aef-aa0e-162e0ca8743e could not be found. May 30 12:05:27.530014 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:05:27.530014 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-4814cb9c-ca5d-4d95-a908-eaf9b1aba4bd tempest-VolumesSnapshotsTestJSON-132726790 tempest-VolumesSnapshotsTestJSON-132726790-project] Returning 404 to user: Snapshot 61ff91f1-c3ee-4aef-aa0e-162e0ca8743e could not be found. {{(pid=117670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:05:27.530014 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-4814cb9c-ca5d-4d95-a908-eaf9b1aba4bd tempest-VolumesSnapshotsTestJSON-132726790 tempest-VolumesSnapshotsTestJSON-132726790-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/61ff91f1-c3ee-4aef-aa0e-162e0ca8743e" status: 404 len: 111 microversion: 2.1 time: 0.043878 May 30 12:05:27.530014 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 91/189] 10.222.0.32 () {58 vars in 1250 bytes} [Mon May 30 12:05:27 2022] GET /compute/v2.1/os-snapshots/61ff91f1-c3ee-4aef-aa0e-162e0ca8743e => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 30 12:05:27.538474 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-0b034a75-da1b-420a-b848-16160ad9bf5b tempest-VolumesSnapshotsTestJSON-132726790 tempest-VolumesSnapshotsTestJSON-132726790-project] Calling method '.version_select at 0x7f0efacb2040>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:27.615619 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-0b034a75-da1b-420a-b848-16160ad9bf5b tempest-VolumesSnapshotsTestJSON-132726790 tempest-VolumesSnapshotsTestJSON-132726790-project] 10.222.0.32 "DELETE /compute/v2.1/os-volumes/61ffe87f-b76e-4b99-96e6-54377c7e4173" status: 202 len: 0 microversion: 2.1 time: 0.081962 May 30 12:05:27.616223 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 99/190] 10.222.0.32 () {58 vars in 1247 bytes} [Mon May 30 12:05:27 2022] DELETE /compute/v2.1/os-volumes/61ffe87f-b76e-4b99-96e6-54377c7e4173 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 30 12:05:27.624541 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-14f5c002-b9a5-483d-977a-44be662a58ae tempest-VolumesSnapshotsTestJSON-132726790 tempest-VolumesSnapshotsTestJSON-132726790-project] Calling method '.version_select at 0x7f0ef8b803a0>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:27.686085 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-14f5c002-b9a5-483d-977a-44be662a58ae tempest-VolumesSnapshotsTestJSON-132726790 tempest-VolumesSnapshotsTestJSON-132726790-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/61ffe87f-b76e-4b99-96e6-54377c7e4173" status: 200 len: 345 microversion: 2.1 time: 0.065504 May 30 12:05:27.686968 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 92/191] 10.222.0.32 () {58 vars in 1244 bytes} [Mon May 30 12:05:27 2022] GET /compute/v2.1/os-volumes/61ffe87f-b76e-4b99-96e6-54377c7e4173 => generated 345 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:05:27.917542 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-31757119-17eb-435a-af27-ced3ed2b325f tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:27.918283 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-31757119-17eb-435a-af27-ced3ed2b325f tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] [instance: cdfbd2ce-7401-4bde-9410-9ea55f87512d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:27.925748 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-31757119-17eb-435a-af27-ced3ed2b325f tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:27.926453 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-31757119-17eb-435a-af27-ced3ed2b325f tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:27.927381 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-31757119-17eb-435a-af27-ced3ed2b325f tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:27.928188 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-31757119-17eb-435a-af27-ced3ed2b325f tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:28.074485 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-31757119-17eb-435a-af27-ced3ed2b325f tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a440b40bc3124bafa502f66a004d0de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7843d3fb7cb402b8a85179da7bfffaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:28.084884 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-31757119-17eb-435a-af27-ced3ed2b325f tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] 10.222.0.32 "GET /compute/v2.1/servers/cdfbd2ce-7401-4bde-9410-9ea55f87512d" status: 200 len: 1313 microversion: 2.1 time: 0.171952 May 30 12:05:28.085461 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 100/192] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:27 2022] GET /compute/v2.1/servers/cdfbd2ce-7401-4bde-9410-9ea55f87512d => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:05:28.187538 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-78f4ab9b-f4aa-4cce-94be-000dccd99f1f tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:28.189082 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-78f4ab9b-f4aa-4cce-94be-000dccd99f1f tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 8542b17d-0c65-4c5d-bc97-9d17545e2126] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:28.198352 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-78f4ab9b-f4aa-4cce-94be-000dccd99f1f tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:28.198352 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-78f4ab9b-f4aa-4cce-94be-000dccd99f1f tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:28.199105 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-78f4ab9b-f4aa-4cce-94be-000dccd99f1f tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:28.199549 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-78f4ab9b-f4aa-4cce-94be-000dccd99f1f tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:28.344144 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-78f4ab9b-f4aa-4cce-94be-000dccd99f1f tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:28.352182 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-78f4ab9b-f4aa-4cce-94be-000dccd99f1f tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126" status: 200 len: 1521 microversion: 2.1 time: 0.169717 May 30 12:05:28.352757 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 93/193] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:28 2022] GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:05:28.701517 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-5f6816da-a070-4c2e-bf2a-13d9b73bf347 tempest-VolumesSnapshotsTestJSON-132726790 tempest-VolumesSnapshotsTestJSON-132726790-project] Calling method '.version_select at 0x7f0ef8987af0>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:28.731832 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.wsgi [None req-5f6816da-a070-4c2e-bf2a-13d9b73bf347 tempest-VolumesSnapshotsTestJSON-132726790 tempest-VolumesSnapshotsTestJSON-132726790-project] HTTP exception thrown: Volume 61ffe87f-b76e-4b99-96e6-54377c7e4173 could not be found. May 30 12:05:28.734790 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-5f6816da-a070-4c2e-bf2a-13d9b73bf347 tempest-VolumesSnapshotsTestJSON-132726790 tempest-VolumesSnapshotsTestJSON-132726790-project] Request method failure captured: May 30 12:05:28.734790 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: request: GET /compute/v2.1/os-volumes/61ffe87f-b76e-4b99-96e6-54377c7e4173 HTTP/1.1 May 30 12:05:28.734790 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Accept: application/json May 30 12:05:28.734790 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Accept-Encoding: identity May 30 12:05:28.734790 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Connection: close May 30 12:05:28.734790 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Content-Length: 0 May 30 12:05:28.734790 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Content-Type: application/json May 30 12:05:28.734790 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Host: 10.222.0.32 May 30 12:05:28.734790 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Openstack-System-Scope: None May 30 12:05:28.734790 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: User-Agent: python-urllib3/1.26.9 May 30 12:05:28.734790 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Auth-Token: gAAAAABilLL_nYoV7ivIs5gzHVXl6tv3hzKlCqbYtTnsLXCfL27LMaJdkZGdlE1dw-oTMojro0XMAzAuAX7l6UPeKgHIMTCOyMZffjWhAQ82mKRPh7FgJJD1TLUOamm30d6AzFqrbpdVt7jTcUCj168vUrw09EGHc3u31iYbkZkR5JZGjuJJydo May 30 12:05:28.734790 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Domain-Id: None May 30 12:05:28.734790 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Domain-Name: None May 30 12:05:28.734790 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Identity-Status: Confirmed May 30 12:05:28.734790 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Is-Admin-Project: True May 30 12:05:28.734790 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Domain-Id: default May 30 12:05:28.734790 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Domain-Name: Default May 30 12:05:28.734790 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Id: e7b01b4dbe234da4abb82077d84bb238 May 30 12:05:28.734790 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-132726790 May 30 12:05:28.734790 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Role: reader,member May 30 12:05:28.734790 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Roles: reader,member May 30 12:05:28.736245 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/e7b01b4dbe234da4abb82077d84bb238"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/e7b01b4dbe234da4abb82077d84bb238"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/e7b01b4dbe234da4abb82077d84bb238"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_e7b01b4dbe234da4abb82077d84bb238", "adminURL": "http://10.222.0.32:8080"}]}] May 30 12:05:28.736245 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Tenant: tempest-VolumesSnapshotsTestJSON-132726790 May 30 12:05:28.736245 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Tenant-Id: e7b01b4dbe234da4abb82077d84bb238 May 30 12:05:28.736245 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-132726790 May 30 12:05:28.736245 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User: tempest-VolumesSnapshotsTestJSON-132726790-project May 30 12:05:28.736245 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Domain-Id: default May 30 12:05:28.736245 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Domain-Name: Default May 30 12:05:28.736245 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Id: 8cba74531efe4959ad40e0390f1609aa May 30 12:05:28.736245 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Name: tempest-VolumesSnapshotsTestJSON-132726790-project May 30 12:05:28.736245 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: method: May 30 12:05:28.736245 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: exception: Volume 61ffe87f-b76e-4b99-96e6-54377c7e4173 could not be found. May 30 12:05:28.736245 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: action_args: {'id': '61ffe87f-b76e-4b99-96e6-54377c7e4173'} May 30 12:05:28.736245 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:05:28.737081 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:05:28.737081 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 30 12:05:28.737081 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 30 12:05:28.737081 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 30 12:05:28.737081 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi item = cinderclient( May 30 12:05:28.737081 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 30 12:05:28.737081 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 30 12:05:28.737081 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 30 12:05:28.737081 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 30 12:05:28.737081 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 30 12:05:28.737081 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 30 12:05:28.737081 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 30 12:05:28.737081 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 30 12:05:28.737081 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 30 12:05:28.737081 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 30 12:05:28.737081 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 61ffe87f-b76e-4b99-96e6-54377c7e4173 could not be found. (HTTP 404) (Request-ID: req-b063d9f8-32a7-46ee-8088-95a186fb938b) May 30 12:05:28.737081 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:05:28.737081 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:05:28.737081 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:05:28.738232 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:05:28.738232 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 30 12:05:28.738232 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 30 12:05:28.738232 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 30 12:05:28.738232 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 30 12:05:28.738232 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 30 12:05:28.738232 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 30 12:05:28.738232 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 30 12:05:28.738232 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 30 12:05:28.738232 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 30 12:05:28.738232 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 30 12:05:28.738232 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 30 12:05:28.738232 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi item = cinderclient( May 30 12:05:28.738232 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 30 12:05:28.738232 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 30 12:05:28.738232 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 30 12:05:28.738232 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 30 12:05:28.738232 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 30 12:05:28.738232 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 30 12:05:28.740004 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 30 12:05:28.740004 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 30 12:05:28.740004 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 30 12:05:28.740004 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 30 12:05:28.740004 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 61ffe87f-b76e-4b99-96e6-54377c7e4173 could not be found. May 30 12:05:28.740004 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:05:28.740004 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:05:28.740004 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:05:28.740004 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:05:28.740004 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:05:28.740004 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:05:28.740004 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:05:28.740004 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:05:28.740004 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 30 12:05:28.740004 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 30 12:05:28.740004 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:05:28.740004 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:05:28.740004 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 30 12:05:28.740004 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:05:28.741149 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 61ffe87f-b76e-4b99-96e6-54377c7e4173 could not be found. May 30 12:05:28.741149 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:05:28.741149 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:05:28.741149 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:05:28.741149 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:05:28.741149 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:05:28.741149 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:05:28.741149 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:05:28.741149 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:05:28.741149 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 61ffe87f-b76e-4b99-96e6-54377c7e4173 could not be found. May 30 12:05:28.741149 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:05:28.741149 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-5f6816da-a070-4c2e-bf2a-13d9b73bf347 tempest-VolumesSnapshotsTestJSON-132726790 tempest-VolumesSnapshotsTestJSON-132726790-project] Returning 404 to user: Volume 61ffe87f-b76e-4b99-96e6-54377c7e4173 could not be found. {{(pid=117671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:05:28.741149 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-5f6816da-a070-4c2e-bf2a-13d9b73bf347 tempest-VolumesSnapshotsTestJSON-132726790 tempest-VolumesSnapshotsTestJSON-132726790-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/61ffe87f-b76e-4b99-96e6-54377c7e4173" status: 404 len: 109 microversion: 2.1 time: 0.039441 May 30 12:05:28.741149 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 101/194] 10.222.0.32 () {58 vars in 1244 bytes} [Mon May 30 12:05:28 2022] GET /compute/v2.1/os-volumes/61ffe87f-b76e-4b99-96e6-54377c7e4173 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 30 12:05:28.747199 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-423a34e0-4d93-4e8e-a7e6-1bd0c68fcac3 tempest-VolumesSnapshotsTestJSON-132726790 tempest-VolumesSnapshotsTestJSON-132726790-project] Calling method '.version_select at 0x7f0ef89b5280>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:28.777611 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.wsgi [None req-423a34e0-4d93-4e8e-a7e6-1bd0c68fcac3 tempest-VolumesSnapshotsTestJSON-132726790 tempest-VolumesSnapshotsTestJSON-132726790-project] HTTP exception thrown: Volume 61ffe87f-b76e-4b99-96e6-54377c7e4173 could not be found. May 30 12:05:28.779683 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-423a34e0-4d93-4e8e-a7e6-1bd0c68fcac3 tempest-VolumesSnapshotsTestJSON-132726790 tempest-VolumesSnapshotsTestJSON-132726790-project] Request method failure captured: May 30 12:05:28.779683 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: request: DELETE /compute/v2.1/os-volumes/61ffe87f-b76e-4b99-96e6-54377c7e4173 HTTP/1.1 May 30 12:05:28.779683 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Accept: application/json May 30 12:05:28.779683 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Accept-Encoding: identity May 30 12:05:28.779683 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Connection: close May 30 12:05:28.779683 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Content-Length: 0 May 30 12:05:28.779683 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Content-Type: application/json May 30 12:05:28.779683 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Host: 10.222.0.32 May 30 12:05:28.779683 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Openstack-System-Scope: None May 30 12:05:28.779683 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: User-Agent: python-urllib3/1.26.9 May 30 12:05:28.779683 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Auth-Token: gAAAAABilLL_nYoV7ivIs5gzHVXl6tv3hzKlCqbYtTnsLXCfL27LMaJdkZGdlE1dw-oTMojro0XMAzAuAX7l6UPeKgHIMTCOyMZffjWhAQ82mKRPh7FgJJD1TLUOamm30d6AzFqrbpdVt7jTcUCj168vUrw09EGHc3u31iYbkZkR5JZGjuJJydo May 30 12:05:28.779683 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Domain-Id: None May 30 12:05:28.779683 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Domain-Name: None May 30 12:05:28.779683 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Identity-Status: Confirmed May 30 12:05:28.779683 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Is-Admin-Project: True May 30 12:05:28.779683 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Domain-Id: default May 30 12:05:28.779683 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Domain-Name: Default May 30 12:05:28.779683 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Id: e7b01b4dbe234da4abb82077d84bb238 May 30 12:05:28.779683 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-132726790 May 30 12:05:28.779683 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Role: reader,member May 30 12:05:28.779683 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Roles: reader,member May 30 12:05:28.781975 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/e7b01b4dbe234da4abb82077d84bb238"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/e7b01b4dbe234da4abb82077d84bb238"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/e7b01b4dbe234da4abb82077d84bb238"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_e7b01b4dbe234da4abb82077d84bb238", "adminURL": "http://10.222.0.32:8080"}]}] May 30 12:05:28.781975 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant: tempest-VolumesSnapshotsTestJSON-132726790 May 30 12:05:28.781975 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant-Id: e7b01b4dbe234da4abb82077d84bb238 May 30 12:05:28.781975 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-132726790 May 30 12:05:28.781975 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User: tempest-VolumesSnapshotsTestJSON-132726790-project May 30 12:05:28.781975 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Domain-Id: default May 30 12:05:28.781975 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Domain-Name: Default May 30 12:05:28.781975 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Id: 8cba74531efe4959ad40e0390f1609aa May 30 12:05:28.781975 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Name: tempest-VolumesSnapshotsTestJSON-132726790-project May 30 12:05:28.781975 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: method: May 30 12:05:28.781975 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: exception: Volume 61ffe87f-b76e-4b99-96e6-54377c7e4173 could not be found. May 30 12:05:28.781975 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: action_args: {'id': '61ffe87f-b76e-4b99-96e6-54377c7e4173'} May 30 12:05:28.781975 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:05:28.783045 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:05:28.783045 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 30 12:05:28.783045 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 30 12:05:28.783045 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 30 12:05:28.783045 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 30 12:05:28.783045 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 30 12:05:28.783045 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 30 12:05:28.783045 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 30 12:05:28.783045 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 30 12:05:28.783045 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 30 12:05:28.783045 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 30 12:05:28.783045 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 30 12:05:28.783045 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 30 12:05:28.783045 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 30 12:05:28.783045 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 30 12:05:28.783045 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 61ffe87f-b76e-4b99-96e6-54377c7e4173 could not be found. (HTTP 404) (Request-ID: req-5b6b45ff-211d-444e-80c8-e4ed32d246eb) May 30 12:05:28.783045 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:05:28.783045 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:05:28.783045 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:05:28.785075 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:05:28.785075 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 30 12:05:28.785075 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 30 12:05:28.785075 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 30 12:05:28.785075 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 30 12:05:28.785075 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 30 12:05:28.785075 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 30 12:05:28.785075 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 30 12:05:28.785075 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 30 12:05:28.785075 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 30 12:05:28.785075 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 30 12:05:28.785075 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 30 12:05:28.785075 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 30 12:05:28.785075 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 30 12:05:28.785075 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 30 12:05:28.785075 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 30 12:05:28.785075 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 30 12:05:28.785075 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 30 12:05:28.785075 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 30 12:05:28.786469 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 30 12:05:28.786469 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 30 12:05:28.786469 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 30 12:05:28.786469 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 30 12:05:28.786469 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 61ffe87f-b76e-4b99-96e6-54377c7e4173 could not be found. May 30 12:05:28.786469 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:05:28.786469 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:05:28.786469 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:05:28.786469 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:05:28.786469 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:05:28.786469 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:05:28.786469 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:05:28.786469 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:05:28.786469 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 30 12:05:28.786469 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 30 12:05:28.786469 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:05:28.786469 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:05:28.786469 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 30 12:05:28.786469 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:05:28.787715 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 61ffe87f-b76e-4b99-96e6-54377c7e4173 could not be found. May 30 12:05:28.787715 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:05:28.787715 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:05:28.787715 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:05:28.787715 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:05:28.787715 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:05:28.787715 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:05:28.787715 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:05:28.787715 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:05:28.787715 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 61ffe87f-b76e-4b99-96e6-54377c7e4173 could not be found. May 30 12:05:28.787715 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:05:28.787715 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-423a34e0-4d93-4e8e-a7e6-1bd0c68fcac3 tempest-VolumesSnapshotsTestJSON-132726790 tempest-VolumesSnapshotsTestJSON-132726790-project] Returning 404 to user: Volume 61ffe87f-b76e-4b99-96e6-54377c7e4173 could not be found. {{(pid=117670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:05:28.787715 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-423a34e0-4d93-4e8e-a7e6-1bd0c68fcac3 tempest-VolumesSnapshotsTestJSON-132726790 tempest-VolumesSnapshotsTestJSON-132726790-project] 10.222.0.32 "DELETE /compute/v2.1/os-volumes/61ffe87f-b76e-4b99-96e6-54377c7e4173" status: 404 len: 109 microversion: 2.1 time: 0.041143 May 30 12:05:28.787715 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 94/195] 10.222.0.32 () {58 vars in 1247 bytes} [Mon May 30 12:05:28 2022] DELETE /compute/v2.1/os-volumes/61ffe87f-b76e-4b99-96e6-54377c7e4173 => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 30 12:05:28.794808 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-c7ffb927-f9fd-4531-aad2-3e4e4a04c0c5 tempest-VolumesSnapshotsTestJSON-132726790 tempest-VolumesSnapshotsTestJSON-132726790-project] Calling method '.version_select at 0x7f0ef89a69d0>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:28.843225 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.wsgi [None req-c7ffb927-f9fd-4531-aad2-3e4e4a04c0c5 tempest-VolumesSnapshotsTestJSON-132726790 tempest-VolumesSnapshotsTestJSON-132726790-project] HTTP exception thrown: Volume 61ffe87f-b76e-4b99-96e6-54377c7e4173 could not be found. May 30 12:05:28.846096 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-c7ffb927-f9fd-4531-aad2-3e4e4a04c0c5 tempest-VolumesSnapshotsTestJSON-132726790 tempest-VolumesSnapshotsTestJSON-132726790-project] Request method failure captured: May 30 12:05:28.846096 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: request: GET /compute/v2.1/os-volumes/61ffe87f-b76e-4b99-96e6-54377c7e4173 HTTP/1.1 May 30 12:05:28.846096 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Accept: application/json May 30 12:05:28.846096 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Accept-Encoding: identity May 30 12:05:28.846096 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Connection: close May 30 12:05:28.846096 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Content-Length: 0 May 30 12:05:28.846096 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Content-Type: application/json May 30 12:05:28.846096 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Host: 10.222.0.32 May 30 12:05:28.846096 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Openstack-System-Scope: None May 30 12:05:28.846096 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: User-Agent: python-urllib3/1.26.9 May 30 12:05:28.846096 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Auth-Token: gAAAAABilLL_nYoV7ivIs5gzHVXl6tv3hzKlCqbYtTnsLXCfL27LMaJdkZGdlE1dw-oTMojro0XMAzAuAX7l6UPeKgHIMTCOyMZffjWhAQ82mKRPh7FgJJD1TLUOamm30d6AzFqrbpdVt7jTcUCj168vUrw09EGHc3u31iYbkZkR5JZGjuJJydo May 30 12:05:28.846096 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Domain-Id: None May 30 12:05:28.846096 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Domain-Name: None May 30 12:05:28.846096 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Identity-Status: Confirmed May 30 12:05:28.846096 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Is-Admin-Project: True May 30 12:05:28.846096 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Domain-Id: default May 30 12:05:28.846096 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Domain-Name: Default May 30 12:05:28.846096 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Id: e7b01b4dbe234da4abb82077d84bb238 May 30 12:05:28.846096 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-132726790 May 30 12:05:28.846096 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Role: reader,member May 30 12:05:28.846096 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Roles: reader,member May 30 12:05:28.847272 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/e7b01b4dbe234da4abb82077d84bb238"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/e7b01b4dbe234da4abb82077d84bb238"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/e7b01b4dbe234da4abb82077d84bb238"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_e7b01b4dbe234da4abb82077d84bb238", "adminURL": "http://10.222.0.32:8080"}]}] May 30 12:05:28.847272 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Tenant: tempest-VolumesSnapshotsTestJSON-132726790 May 30 12:05:28.847272 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Tenant-Id: e7b01b4dbe234da4abb82077d84bb238 May 30 12:05:28.847272 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-132726790 May 30 12:05:28.847272 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User: tempest-VolumesSnapshotsTestJSON-132726790-project May 30 12:05:28.847272 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Domain-Id: default May 30 12:05:28.847272 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Domain-Name: Default May 30 12:05:28.847272 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Id: 8cba74531efe4959ad40e0390f1609aa May 30 12:05:28.847272 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Name: tempest-VolumesSnapshotsTestJSON-132726790-project May 30 12:05:28.847272 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: method: May 30 12:05:28.847272 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: exception: Volume 61ffe87f-b76e-4b99-96e6-54377c7e4173 could not be found. May 30 12:05:28.847272 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: action_args: {'id': '61ffe87f-b76e-4b99-96e6-54377c7e4173'} May 30 12:05:28.847272 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:05:28.848080 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:05:28.848080 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 30 12:05:28.848080 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 30 12:05:28.848080 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 30 12:05:28.848080 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi item = cinderclient( May 30 12:05:28.848080 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 30 12:05:28.848080 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 30 12:05:28.848080 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 30 12:05:28.848080 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 30 12:05:28.848080 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 30 12:05:28.848080 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 30 12:05:28.848080 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 30 12:05:28.848080 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 30 12:05:28.848080 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 30 12:05:28.848080 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 30 12:05:28.848080 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 61ffe87f-b76e-4b99-96e6-54377c7e4173 could not be found. (HTTP 404) (Request-ID: req-1a68f957-f9df-4901-8f42-f14291061307) May 30 12:05:28.848080 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:05:28.848080 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:05:28.848080 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:05:28.849140 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:05:28.849140 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 30 12:05:28.849140 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 30 12:05:28.849140 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 30 12:05:28.849140 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 30 12:05:28.849140 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 30 12:05:28.849140 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 30 12:05:28.849140 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 30 12:05:28.849140 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 30 12:05:28.849140 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 30 12:05:28.849140 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 30 12:05:28.849140 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 30 12:05:28.849140 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi item = cinderclient( May 30 12:05:28.849140 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 30 12:05:28.849140 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 30 12:05:28.849140 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 30 12:05:28.849140 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 30 12:05:28.849140 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 30 12:05:28.849140 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 30 12:05:28.850120 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 30 12:05:28.850120 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 30 12:05:28.850120 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 30 12:05:28.850120 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 30 12:05:28.850120 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 61ffe87f-b76e-4b99-96e6-54377c7e4173 could not be found. May 30 12:05:28.850120 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:05:28.850120 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:05:28.850120 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:05:28.850120 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:05:28.850120 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:05:28.850120 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:05:28.850120 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:05:28.850120 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:05:28.850120 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 30 12:05:28.850120 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 30 12:05:28.850120 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:05:28.850120 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:05:28.850120 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 30 12:05:28.850120 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:05:28.851084 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 61ffe87f-b76e-4b99-96e6-54377c7e4173 could not be found. May 30 12:05:28.851084 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:05:28.851084 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:05:28.851084 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:05:28.851084 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:05:28.851084 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:05:28.851084 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:05:28.851084 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:05:28.851084 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:05:28.851084 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 61ffe87f-b76e-4b99-96e6-54377c7e4173 could not be found. May 30 12:05:28.851084 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:05:28.855373 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-c7ffb927-f9fd-4531-aad2-3e4e4a04c0c5 tempest-VolumesSnapshotsTestJSON-132726790 tempest-VolumesSnapshotsTestJSON-132726790-project] Returning 404 to user: Volume 61ffe87f-b76e-4b99-96e6-54377c7e4173 could not be found. {{(pid=117671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:05:28.856691 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-c7ffb927-f9fd-4531-aad2-3e4e4a04c0c5 tempest-VolumesSnapshotsTestJSON-132726790 tempest-VolumesSnapshotsTestJSON-132726790-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/61ffe87f-b76e-4b99-96e6-54377c7e4173" status: 404 len: 109 microversion: 2.1 time: 0.066663 May 30 12:05:28.860062 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 102/196] 10.222.0.32 () {58 vars in 1244 bytes} [Mon May 30 12:05:28 2022] GET /compute/v2.1/os-volumes/61ffe87f-b76e-4b99-96e6-54377c7e4173 => generated 109 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 30 12:05:29.105581 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-29921b71-e38f-4d94-8b2d-104631d7e648 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:29.106432 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-29921b71-e38f-4d94-8b2d-104631d7e648 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] [instance: cdfbd2ce-7401-4bde-9410-9ea55f87512d] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:29.119882 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-29921b71-e38f-4d94-8b2d-104631d7e648 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:29.121041 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-29921b71-e38f-4d94-8b2d-104631d7e648 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:29.122614 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-29921b71-e38f-4d94-8b2d-104631d7e648 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:29.124131 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-29921b71-e38f-4d94-8b2d-104631d7e648 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:29.317247 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-29921b71-e38f-4d94-8b2d-104631d7e648 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a440b40bc3124bafa502f66a004d0de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7843d3fb7cb402b8a85179da7bfffaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:29.325415 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-29921b71-e38f-4d94-8b2d-104631d7e648 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] 10.222.0.32 "GET /compute/v2.1/servers/cdfbd2ce-7401-4bde-9410-9ea55f87512d" status: 200 len: 1313 microversion: 2.1 time: 0.224100 May 30 12:05:29.326195 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 95/197] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:29 2022] GET /compute/v2.1/servers/cdfbd2ce-7401-4bde-9410-9ea55f87512d => generated 1313 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:05:29.373011 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-087f7fcb-c4bf-4529-9f77-af4772637841 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:29.373872 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-087f7fcb-c4bf-4529-9f77-af4772637841 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 8542b17d-0c65-4c5d-bc97-9d17545e2126] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:29.381260 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-087f7fcb-c4bf-4529-9f77-af4772637841 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:29.381954 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-087f7fcb-c4bf-4529-9f77-af4772637841 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:29.382919 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-087f7fcb-c4bf-4529-9f77-af4772637841 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:29.383709 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-087f7fcb-c4bf-4529-9f77-af4772637841 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:29.541476 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-087f7fcb-c4bf-4529-9f77-af4772637841 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:29.550217 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-087f7fcb-c4bf-4529-9f77-af4772637841 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126" status: 200 len: 1521 microversion: 2.1 time: 0.181024 May 30 12:05:29.550799 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 103/198] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:29 2022] GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:05:30.346314 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-dff02d19-cb20-40ad-9d77-c395743f7b8a tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:30.347232 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-dff02d19-cb20-40ad-9d77-c395743f7b8a tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] [instance: cdfbd2ce-7401-4bde-9410-9ea55f87512d] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:30.353868 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-dff02d19-cb20-40ad-9d77-c395743f7b8a tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:30.354784 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-dff02d19-cb20-40ad-9d77-c395743f7b8a tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:30.355696 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-dff02d19-cb20-40ad-9d77-c395743f7b8a tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:30.356429 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-dff02d19-cb20-40ad-9d77-c395743f7b8a tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:30.562093 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-dff02d19-cb20-40ad-9d77-c395743f7b8a tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a440b40bc3124bafa502f66a004d0de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7843d3fb7cb402b8a85179da7bfffaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:30.567161 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-c8ce171c-9479-48e5-8a54-9985126dfc07 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:30.567985 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-c8ce171c-9479-48e5-8a54-9985126dfc07 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 8542b17d-0c65-4c5d-bc97-9d17545e2126] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:30.575790 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-dff02d19-cb20-40ad-9d77-c395743f7b8a tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] 10.222.0.32 "GET /compute/v2.1/servers/cdfbd2ce-7401-4bde-9410-9ea55f87512d" status: 200 len: 1313 microversion: 2.1 time: 0.235375 May 30 12:05:30.576689 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 96/199] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:30 2022] GET /compute/v2.1/servers/cdfbd2ce-7401-4bde-9410-9ea55f87512d => generated 1313 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:05:30.587215 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c8ce171c-9479-48e5-8a54-9985126dfc07 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:30.587215 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c8ce171c-9479-48e5-8a54-9985126dfc07 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:30.587215 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c8ce171c-9479-48e5-8a54-9985126dfc07 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:30.587215 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c8ce171c-9479-48e5-8a54-9985126dfc07 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:30.816955 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-c8ce171c-9479-48e5-8a54-9985126dfc07 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:30.825357 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-c8ce171c-9479-48e5-8a54-9985126dfc07 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126" status: 200 len: 1521 microversion: 2.1 time: 0.262079 May 30 12:05:30.826331 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 104/200] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:30 2022] GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126 => generated 1521 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:05:30.900424 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-7fad681d-0cec-4ea3-a5e6-c137610eaf32 tempest-VolumesGetTestJSON-252627583 tempest-VolumesGetTestJSON-252627583-project] Action: 'create', calling method: .version_select at 0x7f0ef8aab670>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1895199589", "metadata": {"Type": "work"}}} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:05:31.278451 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-7fad681d-0cec-4ea3-a5e6-c137610eaf32 tempest-VolumesGetTestJSON-252627583 tempest-VolumesGetTestJSON-252627583-project] 10.222.0.32 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.522337 May 30 12:05:31.279521 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 97/201] 10.222.0.32 () {60 vars in 1155 bytes} [Mon May 30 12:05:30 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 524 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) May 30 12:05:31.291145 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-b8531f01-2023-4c6f-9324-f3ffe4e89c05 tempest-VolumesGetTestJSON-252627583 tempest-VolumesGetTestJSON-252627583-project] Calling method '.version_select at 0x7f0ef89af160>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:31.343807 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-b8531f01-2023-4c6f-9324-f3ffe4e89c05 tempest-VolumesGetTestJSON-252627583 tempest-VolumesGetTestJSON-252627583-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/6baf5427-4e0e-4665-9c2e-17994710099f" status: 200 len: 353 microversion: 2.1 time: 0.055546 May 30 12:05:31.344896 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 105/202] 10.222.0.32 () {58 vars in 1244 bytes} [Mon May 30 12:05:31 2022] GET /compute/v2.1/os-volumes/6baf5427-4e0e-4665-9c2e-17994710099f => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:05:31.595927 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-00978c7e-c5ae-43be-9a34-545ebaeb8f62 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:31.596599 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-00978c7e-c5ae-43be-9a34-545ebaeb8f62 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] [instance: cdfbd2ce-7401-4bde-9410-9ea55f87512d] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:31.603380 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-00978c7e-c5ae-43be-9a34-545ebaeb8f62 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:31.603820 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-00978c7e-c5ae-43be-9a34-545ebaeb8f62 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:31.604608 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-00978c7e-c5ae-43be-9a34-545ebaeb8f62 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:31.605164 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-00978c7e-c5ae-43be-9a34-545ebaeb8f62 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:31.746746 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-00978c7e-c5ae-43be-9a34-545ebaeb8f62 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a440b40bc3124bafa502f66a004d0de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7843d3fb7cb402b8a85179da7bfffaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:31.754800 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-00978c7e-c5ae-43be-9a34-545ebaeb8f62 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] 10.222.0.32 "GET /compute/v2.1/servers/cdfbd2ce-7401-4bde-9410-9ea55f87512d" status: 200 len: 1313 microversion: 2.1 time: 0.164729 May 30 12:05:31.755359 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 98/203] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:31 2022] GET /compute/v2.1/servers/cdfbd2ce-7401-4bde-9410-9ea55f87512d => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:05:31.846924 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-50ef5d83-5a00-4011-a857-0ba98a0119bd tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:31.847561 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-50ef5d83-5a00-4011-a857-0ba98a0119bd tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 8542b17d-0c65-4c5d-bc97-9d17545e2126] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:31.853795 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-50ef5d83-5a00-4011-a857-0ba98a0119bd tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:31.854244 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-50ef5d83-5a00-4011-a857-0ba98a0119bd tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:31.855015 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-50ef5d83-5a00-4011-a857-0ba98a0119bd tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:31.855452 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-50ef5d83-5a00-4011-a857-0ba98a0119bd tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:31.996362 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-50ef5d83-5a00-4011-a857-0ba98a0119bd tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:32.005343 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-50ef5d83-5a00-4011-a857-0ba98a0119bd tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126" status: 200 len: 1521 microversion: 2.1 time: 0.162524 May 30 12:05:32.006075 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 106/204] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:31 2022] GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:05:32.358856 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-66774e1b-0d54-472c-9ff7-a74435c23569 tempest-VolumesGetTestJSON-252627583 tempest-VolumesGetTestJSON-252627583-project] Calling method '.version_select at 0x7f0ef8acb820>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:32.419718 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-66774e1b-0d54-472c-9ff7-a74435c23569 tempest-VolumesGetTestJSON-252627583 tempest-VolumesGetTestJSON-252627583-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/6baf5427-4e0e-4665-9c2e-17994710099f" status: 200 len: 354 microversion: 2.1 time: 0.065105 May 30 12:05:32.420361 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 99/205] 10.222.0.32 () {58 vars in 1244 bytes} [Mon May 30 12:05:32 2022] GET /compute/v2.1/os-volumes/6baf5427-4e0e-4665-9c2e-17994710099f => generated 354 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:05:32.434153 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-87f5fc99-f4e5-40f7-9c91-4b7fb87ec8de tempest-VolumesGetTestJSON-252627583 tempest-VolumesGetTestJSON-252627583-project] Calling method '.version_select at 0x7f0ef8987ee0>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:32.511690 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-87f5fc99-f4e5-40f7-9c91-4b7fb87ec8de tempest-VolumesGetTestJSON-252627583 tempest-VolumesGetTestJSON-252627583-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/6baf5427-4e0e-4665-9c2e-17994710099f" status: 200 len: 354 microversion: 2.1 time: 0.081642 May 30 12:05:32.512284 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 107/206] 10.222.0.32 () {58 vars in 1244 bytes} [Mon May 30 12:05:32 2022] GET /compute/v2.1/os-volumes/6baf5427-4e0e-4665-9c2e-17994710099f => generated 354 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:05:32.528071 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-bdffee12-291b-4bde-ba82-c034c654b0a7 tempest-VolumesGetTestJSON-252627583 tempest-VolumesGetTestJSON-252627583-project] Calling method '.version_select at 0x7f0ef8999d30>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:32.619242 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-bdffee12-291b-4bde-ba82-c034c654b0a7 tempest-VolumesGetTestJSON-252627583 tempest-VolumesGetTestJSON-252627583-project] 10.222.0.32 "DELETE /compute/v2.1/os-volumes/6baf5427-4e0e-4665-9c2e-17994710099f" status: 202 len: 0 microversion: 2.1 time: 0.095925 May 30 12:05:32.620950 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 100/207] 10.222.0.32 () {58 vars in 1247 bytes} [Mon May 30 12:05:32 2022] DELETE /compute/v2.1/os-volumes/6baf5427-4e0e-4665-9c2e-17994710099f => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 30 12:05:32.630849 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-fb27af4e-a101-4131-8017-ae12c2325b06 tempest-VolumesGetTestJSON-252627583 tempest-VolumesGetTestJSON-252627583-project] Calling method '.version_select at 0x7f0ef89af0d0>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:32.636025 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-1181822f-2f1d-4ca9-b37a-b361c7bade78 req-e70ab3b2-21a7-42fb-bccc-ed0444f8fce3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdfbd2ce-7401-4bde-9410-9ea55f87512d", "name": "network-vif-plugged", "status": "completed", "tag": "84c3ed34-6a52-4ea0-a521-fc8b43d9a88d"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:05:32.648643 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-1181822f-2f1d-4ca9-b37a-b361c7bade78 req-e70ab3b2-21a7-42fb-bccc-ed0444f8fce3 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:32.649221 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-1181822f-2f1d-4ca9-b37a-b361c7bade78 req-e70ab3b2-21a7-42fb-bccc-ed0444f8fce3 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:32.666296 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-1181822f-2f1d-4ca9-b37a-b361c7bade78 req-e70ab3b2-21a7-42fb-bccc-ed0444f8fce3 service nova] Creating event network-vif-plugged:84c3ed34-6a52-4ea0-a521-fc8b43d9a88d for instance cdfbd2ce-7401-4bde-9410-9ea55f87512d on hv-cinder-84051 May 30 12:05:32.674320 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-1181822f-2f1d-4ca9-b37a-b361c7bade78 req-e70ab3b2-21a7-42fb-bccc-ed0444f8fce3 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043450 May 30 12:05:32.675919 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 101/208] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:05:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:05:32.699850 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-fb27af4e-a101-4131-8017-ae12c2325b06 tempest-VolumesGetTestJSON-252627583 tempest-VolumesGetTestJSON-252627583-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/6baf5427-4e0e-4665-9c2e-17994710099f" status: 200 len: 353 microversion: 2.1 time: 0.073933 May 30 12:05:32.705371 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 108/209] 10.222.0.32 () {58 vars in 1244 bytes} [Mon May 30 12:05:32 2022] GET /compute/v2.1/os-volumes/6baf5427-4e0e-4665-9c2e-17994710099f => generated 353 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:05:32.772007 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-7d28c284-57dc-4326-98fe-df9c2c84c9d3 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:32.772754 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-7d28c284-57dc-4326-98fe-df9c2c84c9d3 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] [instance: cdfbd2ce-7401-4bde-9410-9ea55f87512d] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:32.790740 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7d28c284-57dc-4326-98fe-df9c2c84c9d3 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:32.791869 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7d28c284-57dc-4326-98fe-df9c2c84c9d3 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:32.794972 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7d28c284-57dc-4326-98fe-df9c2c84c9d3 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:32.795506 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7d28c284-57dc-4326-98fe-df9c2c84c9d3 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:32.826723 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell1:SELECT=100 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:05:32.992798 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-7d28c284-57dc-4326-98fe-df9c2c84c9d3 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a440b40bc3124bafa502f66a004d0de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7843d3fb7cb402b8a85179da7bfffaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:33.004452 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-7d28c284-57dc-4326-98fe-df9c2c84c9d3 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] 10.222.0.32 "GET /compute/v2.1/servers/cdfbd2ce-7401-4bde-9410-9ea55f87512d" status: 200 len: 1313 microversion: 2.1 time: 0.236516 May 30 12:05:33.005441 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 102/210] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:32 2022] GET /compute/v2.1/servers/cdfbd2ce-7401-4bde-9410-9ea55f87512d => generated 1313 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:05:33.024180 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-264b7897-95e1-47d3-aec2-c5f7217fb0ac tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:33.024818 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-264b7897-95e1-47d3-aec2-c5f7217fb0ac tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 8542b17d-0c65-4c5d-bc97-9d17545e2126] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:33.031289 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-264b7897-95e1-47d3-aec2-c5f7217fb0ac tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:33.031776 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-264b7897-95e1-47d3-aec2-c5f7217fb0ac tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:33.032804 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-264b7897-95e1-47d3-aec2-c5f7217fb0ac tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:33.033240 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-264b7897-95e1-47d3-aec2-c5f7217fb0ac tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:33.177584 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-264b7897-95e1-47d3-aec2-c5f7217fb0ac tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:33.186259 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-264b7897-95e1-47d3-aec2-c5f7217fb0ac tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126" status: 200 len: 1521 microversion: 2.1 time: 0.166388 May 30 12:05:33.186832 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 109/211] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:33 2022] GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:05:33.712695 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-7aee1d47-83fd-4536-b605-03eabc721910 tempest-VolumesGetTestJSON-252627583 tempest-VolumesGetTestJSON-252627583-project] Calling method '.version_select at 0x7f0ef8acb040>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:33.720226 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell0:SELECT=2 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:05:33.721002 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell0:SELECT=8 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:05:33.743762 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.wsgi [None req-7aee1d47-83fd-4536-b605-03eabc721910 tempest-VolumesGetTestJSON-252627583 tempest-VolumesGetTestJSON-252627583-project] HTTP exception thrown: Volume 6baf5427-4e0e-4665-9c2e-17994710099f could not be found. May 30 12:05:33.745873 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-7aee1d47-83fd-4536-b605-03eabc721910 tempest-VolumesGetTestJSON-252627583 tempest-VolumesGetTestJSON-252627583-project] Request method failure captured: May 30 12:05:33.745873 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: request: GET /compute/v2.1/os-volumes/6baf5427-4e0e-4665-9c2e-17994710099f HTTP/1.1 May 30 12:05:33.745873 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Accept: application/json May 30 12:05:33.745873 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Accept-Encoding: identity May 30 12:05:33.745873 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Connection: close May 30 12:05:33.745873 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Content-Length: 0 May 30 12:05:33.745873 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Content-Type: application/json May 30 12:05:33.745873 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Host: 10.222.0.32 May 30 12:05:33.745873 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Openstack-System-Scope: None May 30 12:05:33.745873 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: User-Agent: python-urllib3/1.26.9 May 30 12:05:33.745873 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Auth-Token: gAAAAABilLMKPTiU6_3w61JcBXk01raJvs8SCuZHQ1VPT3Wb7UbTCB9v_VDLNyph8ljVSyZxKlwMPd8HW4RLaiVZelCTD60XSsmo9UXWFhHiz9rmOp5w0cRzx6N3vOWG7xJShXd7Xbth2NFgGMfISGkNdw0uwwbJX8kzgxD3jkO9jm3OotXIFDs May 30 12:05:33.745873 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Domain-Id: None May 30 12:05:33.745873 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Domain-Name: None May 30 12:05:33.745873 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Identity-Status: Confirmed May 30 12:05:33.745873 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Is-Admin-Project: True May 30 12:05:33.745873 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Domain-Id: default May 30 12:05:33.745873 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Domain-Name: Default May 30 12:05:33.745873 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Id: eae1bcd894ca400ea2eb04926906edaa May 30 12:05:33.745873 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Name: tempest-VolumesGetTestJSON-252627583 May 30 12:05:33.745873 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Role: reader,member May 30 12:05:33.745873 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Roles: reader,member May 30 12:05:33.747181 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/eae1bcd894ca400ea2eb04926906edaa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/eae1bcd894ca400ea2eb04926906edaa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/eae1bcd894ca400ea2eb04926906edaa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_eae1bcd894ca400ea2eb04926906edaa", "adminURL": "http://10.222.0.32:8080"}]}] May 30 12:05:33.747181 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant: tempest-VolumesGetTestJSON-252627583 May 30 12:05:33.747181 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant-Id: eae1bcd894ca400ea2eb04926906edaa May 30 12:05:33.747181 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant-Name: tempest-VolumesGetTestJSON-252627583 May 30 12:05:33.747181 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User: tempest-VolumesGetTestJSON-252627583-project May 30 12:05:33.747181 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Domain-Id: default May 30 12:05:33.747181 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Domain-Name: Default May 30 12:05:33.747181 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Id: f12943fa264049fba93a72026f2477ca May 30 12:05:33.747181 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Name: tempest-VolumesGetTestJSON-252627583-project May 30 12:05:33.747181 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: method: May 30 12:05:33.747181 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: exception: Volume 6baf5427-4e0e-4665-9c2e-17994710099f could not be found. May 30 12:05:33.747181 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: action_args: {'id': '6baf5427-4e0e-4665-9c2e-17994710099f'} May 30 12:05:33.747181 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:05:33.748129 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:05:33.748129 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 30 12:05:33.748129 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 30 12:05:33.748129 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 30 12:05:33.748129 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi item = cinderclient( May 30 12:05:33.748129 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 30 12:05:33.748129 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 30 12:05:33.748129 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 30 12:05:33.748129 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 30 12:05:33.748129 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 30 12:05:33.748129 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 30 12:05:33.748129 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 30 12:05:33.748129 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 30 12:05:33.748129 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 30 12:05:33.748129 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 30 12:05:33.748129 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6baf5427-4e0e-4665-9c2e-17994710099f could not be found. (HTTP 404) (Request-ID: req-7dfc4be5-cae1-4326-8bd6-f9063bfa44f2) May 30 12:05:33.748129 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:05:33.748129 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:05:33.748129 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:05:33.749552 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:05:33.749552 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 30 12:05:33.749552 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 30 12:05:33.749552 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 30 12:05:33.749552 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 30 12:05:33.749552 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 30 12:05:33.749552 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 30 12:05:33.749552 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 30 12:05:33.749552 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 30 12:05:33.749552 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 30 12:05:33.749552 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 30 12:05:33.749552 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 30 12:05:33.749552 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi item = cinderclient( May 30 12:05:33.749552 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 30 12:05:33.749552 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 30 12:05:33.749552 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 30 12:05:33.749552 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 30 12:05:33.749552 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 30 12:05:33.749552 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 30 12:05:33.751053 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 30 12:05:33.751053 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 30 12:05:33.751053 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 30 12:05:33.751053 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 30 12:05:33.751053 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6baf5427-4e0e-4665-9c2e-17994710099f could not be found. May 30 12:05:33.751053 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:05:33.751053 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:05:33.751053 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:05:33.751053 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:05:33.751053 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:05:33.751053 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:05:33.751053 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:05:33.751053 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:05:33.751053 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 30 12:05:33.751053 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 30 12:05:33.751053 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:05:33.751053 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:05:33.751053 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 30 12:05:33.751053 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:05:33.752340 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6baf5427-4e0e-4665-9c2e-17994710099f could not be found. May 30 12:05:33.752340 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:05:33.752340 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:05:33.752340 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:05:33.752340 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:05:33.752340 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:05:33.752340 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:05:33.752340 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:05:33.752340 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:05:33.752340 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6baf5427-4e0e-4665-9c2e-17994710099f could not be found. May 30 12:05:33.752340 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:05:33.752340 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-7aee1d47-83fd-4536-b605-03eabc721910 tempest-VolumesGetTestJSON-252627583 tempest-VolumesGetTestJSON-252627583-project] Returning 404 to user: Volume 6baf5427-4e0e-4665-9c2e-17994710099f could not be found. {{(pid=117670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:05:33.752340 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-7aee1d47-83fd-4536-b605-03eabc721910 tempest-VolumesGetTestJSON-252627583 tempest-VolumesGetTestJSON-252627583-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/6baf5427-4e0e-4665-9c2e-17994710099f" status: 404 len: 109 microversion: 2.1 time: 0.038472 May 30 12:05:33.752340 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 103/212] 10.222.0.32 () {58 vars in 1244 bytes} [Mon May 30 12:05:33 2022] GET /compute/v2.1/os-volumes/6baf5427-4e0e-4665-9c2e-17994710099f => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 30 12:05:34.025262 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-a7f8008e-97c2-43b4-8a23-db55850047e2 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:34.025898 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-a7f8008e-97c2-43b4-8a23-db55850047e2 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] [instance: cdfbd2ce-7401-4bde-9410-9ea55f87512d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:34.052454 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a7f8008e-97c2-43b4-8a23-db55850047e2 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:34.052896 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a7f8008e-97c2-43b4-8a23-db55850047e2 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:34.053899 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a7f8008e-97c2-43b4-8a23-db55850047e2 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:34.054505 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a7f8008e-97c2-43b4-8a23-db55850047e2 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:34.204578 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-f270a7b6-5951-4977-ab35-66ddf2054d2f tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:34.205115 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-f270a7b6-5951-4977-ab35-66ddf2054d2f tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 8542b17d-0c65-4c5d-bc97-9d17545e2126] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:34.212255 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f270a7b6-5951-4977-ab35-66ddf2054d2f tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:34.212718 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f270a7b6-5951-4977-ab35-66ddf2054d2f tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:34.213505 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f270a7b6-5951-4977-ab35-66ddf2054d2f tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:34.213947 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f270a7b6-5951-4977-ab35-66ddf2054d2f tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:34.535709 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-a7f8008e-97c2-43b4-8a23-db55850047e2 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a440b40bc3124bafa502f66a004d0de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7843d3fb7cb402b8a85179da7bfffaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:34.544502 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-a7f8008e-97c2-43b4-8a23-db55850047e2 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] 10.222.0.32 "GET /compute/v2.1/servers/cdfbd2ce-7401-4bde-9410-9ea55f87512d" status: 200 len: 1313 microversion: 2.1 time: 0.525068 May 30 12:05:34.545079 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 110/213] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:34 2022] GET /compute/v2.1/servers/cdfbd2ce-7401-4bde-9410-9ea55f87512d => generated 1313 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:05:34.698779 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-f270a7b6-5951-4977-ab35-66ddf2054d2f tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:34.712279 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-f270a7b6-5951-4977-ab35-66ddf2054d2f tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126" status: 200 len: 1521 microversion: 2.1 time: 0.512104 May 30 12:05:34.713438 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 104/214] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:34 2022] GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126 => generated 1521 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:05:35.567766 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-c945b10d-7384-423a-a0ff-8f6b4cc8f500 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:35.568477 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-c945b10d-7384-423a-a0ff-8f6b4cc8f500 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] [instance: cdfbd2ce-7401-4bde-9410-9ea55f87512d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:35.574876 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c945b10d-7384-423a-a0ff-8f6b4cc8f500 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:35.575687 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c945b10d-7384-423a-a0ff-8f6b4cc8f500 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:35.576762 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c945b10d-7384-423a-a0ff-8f6b4cc8f500 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:35.577406 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c945b10d-7384-423a-a0ff-8f6b4cc8f500 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:35.728479 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-c945b10d-7384-423a-a0ff-8f6b4cc8f500 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a440b40bc3124bafa502f66a004d0de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7843d3fb7cb402b8a85179da7bfffaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:35.733251 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-17267ac0-cef2-45c0-bd1d-a69bb2c69c70 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:35.736441 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-17267ac0-cef2-45c0-bd1d-a69bb2c69c70 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 8542b17d-0c65-4c5d-bc97-9d17545e2126] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:35.739073 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-c945b10d-7384-423a-a0ff-8f6b4cc8f500 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] 10.222.0.32 "GET /compute/v2.1/servers/cdfbd2ce-7401-4bde-9410-9ea55f87512d" status: 200 len: 1497 microversion: 2.1 time: 0.175887 May 30 12:05:35.740317 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 111/215] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:35 2022] GET /compute/v2.1/servers/cdfbd2ce-7401-4bde-9410-9ea55f87512d => generated 1497 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:05:35.767635 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-17267ac0-cef2-45c0-bd1d-a69bb2c69c70 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:35.769049 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-17267ac0-cef2-45c0-bd1d-a69bb2c69c70 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:35.771502 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-17267ac0-cef2-45c0-bd1d-a69bb2c69c70 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:35.772419 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-17267ac0-cef2-45c0-bd1d-a69bb2c69c70 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:35.934306 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-17267ac0-cef2-45c0-bd1d-a69bb2c69c70 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:35.943103 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-17267ac0-cef2-45c0-bd1d-a69bb2c69c70 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126" status: 200 len: 1521 microversion: 2.1 time: 0.216695 May 30 12:05:35.943836 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 105/216] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:35 2022] GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126 => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:05:36.862384 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-23160910-6c76-41ed-8f19-93e163831e13 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:36.863029 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-23160910-6c76-41ed-8f19-93e163831e13 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] [instance: cdfbd2ce-7401-4bde-9410-9ea55f87512d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:36.870294 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-23160910-6c76-41ed-8f19-93e163831e13 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:36.870795 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-23160910-6c76-41ed-8f19-93e163831e13 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:36.871603 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-23160910-6c76-41ed-8f19-93e163831e13 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:36.872111 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-23160910-6c76-41ed-8f19-93e163831e13 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:36.898410 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-23160910-6c76-41ed-8f19-93e163831e13 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] [instance: cdfbd2ce-7401-4bde-9410-9ea55f87512d] Going to try to terminate instance {{(pid=117671) delete /opt/stack/nova/nova/compute/api.py:2664}} May 30 12:05:36.960632 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-5db7cf6d-fef6-44dc-9163-e92ea8c8c0cc tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:36.961461 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-5db7cf6d-fef6-44dc-9163-e92ea8c8c0cc tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 8542b17d-0c65-4c5d-bc97-9d17545e2126] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:36.970496 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5db7cf6d-fef6-44dc-9163-e92ea8c8c0cc tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:36.970942 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5db7cf6d-fef6-44dc-9163-e92ea8c8c0cc tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:36.971735 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5db7cf6d-fef6-44dc-9163-e92ea8c8c0cc tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:36.972182 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5db7cf6d-fef6-44dc-9163-e92ea8c8c0cc tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:36.989174 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-23160910-6c76-41ed-8f19-93e163831e13 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] 10.222.0.32 "DELETE /compute/v2.1/servers/cdfbd2ce-7401-4bde-9410-9ea55f87512d" status: 204 len: 0 microversion: 2.1 time: 0.130411 May 30 12:05:36.990497 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 112/217] 10.222.0.32 () {58 vars in 1238 bytes} [Mon May 30 12:05:36 2022] DELETE /compute/v2.1/servers/cdfbd2ce-7401-4bde-9410-9ea55f87512d => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 30 12:05:36.998887 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-e4962212-7aaa-4b49-8aeb-576f9d8814d7 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:36.999587 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-e4962212-7aaa-4b49-8aeb-576f9d8814d7 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] [instance: cdfbd2ce-7401-4bde-9410-9ea55f87512d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:37.006294 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e4962212-7aaa-4b49-8aeb-576f9d8814d7 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:37.006740 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e4962212-7aaa-4b49-8aeb-576f9d8814d7 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:37.007522 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e4962212-7aaa-4b49-8aeb-576f9d8814d7 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:37.007945 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e4962212-7aaa-4b49-8aeb-576f9d8814d7 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:37.188122 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-5db7cf6d-fef6-44dc-9163-e92ea8c8c0cc tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:37.196463 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-e4962212-7aaa-4b49-8aeb-576f9d8814d7 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a440b40bc3124bafa502f66a004d0de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7843d3fb7cb402b8a85179da7bfffaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:37.198017 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-5db7cf6d-fef6-44dc-9163-e92ea8c8c0cc tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126" status: 200 len: 1521 microversion: 2.1 time: 0.242144 May 30 12:05:37.198604 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 106/218] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:36 2022] GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126 => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:05:37.204807 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-e4962212-7aaa-4b49-8aeb-576f9d8814d7 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] 10.222.0.32 "GET /compute/v2.1/servers/cdfbd2ce-7401-4bde-9410-9ea55f87512d" status: 200 len: 1503 microversion: 2.1 time: 0.210318 May 30 12:05:37.205383 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 113/219] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:36 2022] GET /compute/v2.1/servers/cdfbd2ce-7401-4bde-9410-9ea55f87512d => generated 1503 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:05:37.522844 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-ee3fd741-75fe-466d-b6e5-d0b5b98645c8 tempest-VolumesTestJSON-560123665 tempest-VolumesTestJSON-560123665-project] Calling method '.version_select at 0x7f0ef89995e0>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:37.580099 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-ee3fd741-75fe-466d-b6e5-d0b5b98645c8 tempest-VolumesTestJSON-560123665 tempest-VolumesTestJSON-560123665-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/0697454e-bd12-4607-b031-1fece32b0010" status: 200 len: 350 microversion: 2.1 time: 0.061159 May 30 12:05:37.580851 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 107/220] 10.222.0.32 () {58 vars in 1244 bytes} [Mon May 30 12:05:37 2022] GET /compute/v2.1/os-volumes/0697454e-bd12-4607-b031-1fece32b0010 => generated 350 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:05:38.215497 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-4fdb40a1-5c02-4c43-8339-69acf6007dcc tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:38.216253 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-4fdb40a1-5c02-4c43-8339-69acf6007dcc tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 8542b17d-0c65-4c5d-bc97-9d17545e2126] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:38.223047 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-959106a5-af09-4dd6-81ff-4693ea6dbcd0 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:38.223794 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-959106a5-af09-4dd6-81ff-4693ea6dbcd0 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] [instance: cdfbd2ce-7401-4bde-9410-9ea55f87512d] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:38.224200 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4fdb40a1-5c02-4c43-8339-69acf6007dcc tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:38.224653 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4fdb40a1-5c02-4c43-8339-69acf6007dcc tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:38.225418 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4fdb40a1-5c02-4c43-8339-69acf6007dcc tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:38.225847 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4fdb40a1-5c02-4c43-8339-69acf6007dcc tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:38.230190 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-959106a5-af09-4dd6-81ff-4693ea6dbcd0 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:38.230646 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-959106a5-af09-4dd6-81ff-4693ea6dbcd0 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:38.231421 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-959106a5-af09-4dd6-81ff-4693ea6dbcd0 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:38.231870 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-959106a5-af09-4dd6-81ff-4693ea6dbcd0 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:38.440527 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-4fdb40a1-5c02-4c43-8339-69acf6007dcc tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:38.447918 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-959106a5-af09-4dd6-81ff-4693ea6dbcd0 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a440b40bc3124bafa502f66a004d0de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7843d3fb7cb402b8a85179da7bfffaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:38.448190 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-4fdb40a1-5c02-4c43-8339-69acf6007dcc tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126" status: 200 len: 1521 microversion: 2.1 time: 0.236472 May 30 12:05:38.448777 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 114/221] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:38 2022] GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126 => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:05:38.455843 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-959106a5-af09-4dd6-81ff-4693ea6dbcd0 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] 10.222.0.32 "GET /compute/v2.1/servers/cdfbd2ce-7401-4bde-9410-9ea55f87512d" status: 200 len: 1503 microversion: 2.1 time: 0.237884 May 30 12:05:38.456465 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 108/222] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:38 2022] GET /compute/v2.1/servers/cdfbd2ce-7401-4bde-9410-9ea55f87512d => generated 1503 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:05:38.936251 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-aa057e39-818c-4056-bc6a-8c71bcbc7749 tempest-VolumesTestJSON-560123665 tempest-VolumesTestJSON-560123665-project] Calling method '.version_select at 0x7f0ef89a7790>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:38.990951 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-aa057e39-818c-4056-bc6a-8c71bcbc7749 tempest-VolumesTestJSON-560123665 tempest-VolumesTestJSON-560123665-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/c72b63b3-8019-43f8-9729-74bd36eb8c5c" status: 200 len: 350 microversion: 2.1 time: 0.058330 May 30 12:05:38.991546 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 115/223] 10.222.0.32 () {58 vars in 1244 bytes} [Mon May 30 12:05:38 2022] GET /compute/v2.1/os-volumes/c72b63b3-8019-43f8-9729-74bd36eb8c5c => generated 350 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:05:39.465144 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-d6f74db7-0c53-4a11-a8d1-7df7dab00eed tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:39.465767 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-d6f74db7-0c53-4a11-a8d1-7df7dab00eed tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 8542b17d-0c65-4c5d-bc97-9d17545e2126] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:39.473434 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d6f74db7-0c53-4a11-a8d1-7df7dab00eed tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:39.473601 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-71e099b5-be75-4116-a2a6-72b1d36ec47a tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:39.474025 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d6f74db7-0c53-4a11-a8d1-7df7dab00eed tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:39.474120 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-71e099b5-be75-4116-a2a6-72b1d36ec47a tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] [instance: cdfbd2ce-7401-4bde-9410-9ea55f87512d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:39.474650 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d6f74db7-0c53-4a11-a8d1-7df7dab00eed tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:39.475090 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d6f74db7-0c53-4a11-a8d1-7df7dab00eed tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:39.480125 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-71e099b5-be75-4116-a2a6-72b1d36ec47a tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:39.480607 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-71e099b5-be75-4116-a2a6-72b1d36ec47a tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:39.481369 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-71e099b5-be75-4116-a2a6-72b1d36ec47a tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:39.481803 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-71e099b5-be75-4116-a2a6-72b1d36ec47a tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:39.484598 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:05:39.690116 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-d6f74db7-0c53-4a11-a8d1-7df7dab00eed tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:39.697859 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-d6f74db7-0c53-4a11-a8d1-7df7dab00eed tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126" status: 200 len: 1521 microversion: 2.1 time: 0.236703 May 30 12:05:39.698445 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 109/224] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:39 2022] GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126 => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:05:39.699061 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-71e099b5-be75-4116-a2a6-72b1d36ec47a tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a440b40bc3124bafa502f66a004d0de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7843d3fb7cb402b8a85179da7bfffaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:39.707292 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-71e099b5-be75-4116-a2a6-72b1d36ec47a tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] 10.222.0.32 "GET /compute/v2.1/servers/cdfbd2ce-7401-4bde-9410-9ea55f87512d" status: 200 len: 1503 microversion: 2.1 time: 0.238465 May 30 12:05:39.707857 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 116/225] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:39 2022] GET /compute/v2.1/servers/cdfbd2ce-7401-4bde-9410-9ea55f87512d => generated 1503 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:05:40.228346 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-e9619f4c-5538-4867-ab10-dfa7a2340527 req-d538f9f1-0add-466e-a8f1-aae9791319b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdfbd2ce-7401-4bde-9410-9ea55f87512d", "name": "network-vif-deleted", "tag": "84c3ed34-6a52-4ea0-a521-fc8b43d9a88d"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:05:40.238894 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-e9619f4c-5538-4867-ab10-dfa7a2340527 req-d538f9f1-0add-466e-a8f1-aae9791319b1 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:40.239664 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-e9619f4c-5538-4867-ab10-dfa7a2340527 req-d538f9f1-0add-466e-a8f1-aae9791319b1 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:40.254395 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-e9619f4c-5538-4867-ab10-dfa7a2340527 req-d538f9f1-0add-466e-a8f1-aae9791319b1 service nova] Creating event network-vif-deleted:84c3ed34-6a52-4ea0-a521-fc8b43d9a88d for instance cdfbd2ce-7401-4bde-9410-9ea55f87512d on hv-cinder-84051 May 30 12:05:40.259424 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-e9619f4c-5538-4867-ab10-dfa7a2340527 req-d538f9f1-0add-466e-a8f1-aae9791319b1 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036338 May 30 12:05:40.260021 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 110/226] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:05:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:05:40.349506 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-d74d9d1a-59c8-44aa-aa67-2d1c2ddf47b0 tempest-VolumesTestJSON-560123665 tempest-VolumesTestJSON-560123665-project] Calling method '.version_select at 0x7f0ef89a75e0>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:40.404499 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-d74d9d1a-59c8-44aa-aa67-2d1c2ddf47b0 tempest-VolumesTestJSON-560123665 tempest-VolumesTestJSON-560123665-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/bb6258a0-be30-4c85-b1d7-777dff2e6c37" status: 200 len: 351 microversion: 2.1 time: 0.059176 May 30 12:05:40.405207 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 117/227] 10.222.0.32 () {58 vars in 1244 bytes} [Mon May 30 12:05:40 2022] GET /compute/v2.1/os-volumes/bb6258a0-be30-4c85-b1d7-777dff2e6c37 => generated 351 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:05:40.416759 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-fc05fcc0-46cf-4082-83ac-4345410447be tempest-VolumesTestJSON-560123665 tempest-VolumesTestJSON-560123665-project] Calling method '.version_select at 0x7f0ef893f3a0>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:40.502688 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-fc05fcc0-46cf-4082-83ac-4345410447be tempest-VolumesTestJSON-560123665 tempest-VolumesTestJSON-560123665-project] 10.222.0.32 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.090228 May 30 12:05:40.508259 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 111/228] 10.222.0.32 () {58 vars in 1133 bytes} [Mon May 30 12:05:40 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:05:40.515101 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-baa8914d-c7bf-4efa-b617-9f6bf434c502 tempest-VolumesTestJSON-560123665 tempest-VolumesTestJSON-560123665-project] Calling method '.version_select at 0x7f0ef89a7ca0>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:40.604187 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-baa8914d-c7bf-4efa-b617-9f6bf434c502 tempest-VolumesTestJSON-560123665 tempest-VolumesTestJSON-560123665-project] 10.222.0.32 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.092728 May 30 12:05:40.604765 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 118/229] 10.222.0.32 () {58 vars in 1148 bytes} [Mon May 30 12:05:40 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:05:40.616704 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-18f5623d-316e-4cf4-ab6e-18bd5a24d6f4 tempest-VolumesTestJSON-560123665 tempest-VolumesTestJSON-560123665-project] Calling method '.version_select at 0x7f0ef89994c0>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:40.699041 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-18f5623d-316e-4cf4-ab6e-18bd5a24d6f4 tempest-VolumesTestJSON-560123665 tempest-VolumesTestJSON-560123665-project] 10.222.0.32 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.086113 May 30 12:05:40.699694 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 112/230] 10.222.0.32 () {58 vars in 1133 bytes} [Mon May 30 12:05:40 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:05:40.711465 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-17382a7f-5dec-411d-8c51-f9631840db99 tempest-VolumesTestJSON-560123665 tempest-VolumesTestJSON-560123665-project] Calling method '.version_select at 0x7f0ef89af4c0>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:40.716224 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-8de7b1de-ed40-486a-9e37-29c752975c3e tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:40.716933 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-8de7b1de-ed40-486a-9e37-29c752975c3e tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 8542b17d-0c65-4c5d-bc97-9d17545e2126] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:40.724328 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8de7b1de-ed40-486a-9e37-29c752975c3e tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:40.724950 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8de7b1de-ed40-486a-9e37-29c752975c3e tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:40.725906 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8de7b1de-ed40-486a-9e37-29c752975c3e tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:40.726345 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8de7b1de-ed40-486a-9e37-29c752975c3e tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:40.795384 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-17382a7f-5dec-411d-8c51-f9631840db99 tempest-VolumesTestJSON-560123665 tempest-VolumesTestJSON-560123665-project] 10.222.0.32 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.087578 May 30 12:05:40.796229 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 119/231] 10.222.0.32 () {58 vars in 1166 bytes} [Mon May 30 12:05:40 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:05:40.810669 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-0f00f4b0-8ea8-40c7-8a06-7545658dd31a tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:40.811701 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-0f00f4b0-8ea8-40c7-8a06-7545658dd31a tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] [instance: cdfbd2ce-7401-4bde-9410-9ea55f87512d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:40.819327 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0f00f4b0-8ea8-40c7-8a06-7545658dd31a tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:40.819768 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0f00f4b0-8ea8-40c7-8a06-7545658dd31a tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:40.820560 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0f00f4b0-8ea8-40c7-8a06-7545658dd31a tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:40.821000 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0f00f4b0-8ea8-40c7-8a06-7545658dd31a tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:40.851590 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0f00f4b0-8ea8-40c7-8a06-7545658dd31a tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:40.852093 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0f00f4b0-8ea8-40c7-8a06-7545658dd31a tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:40.852497 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.objects.instance [None req-0f00f4b0-8ea8-40c7-8a06-7545658dd31a tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lazy-loading 'fault' on Instance uuid cdfbd2ce-7401-4bde-9410-9ea55f87512d {{(pid=117671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 30 12:05:40.866650 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-8de7b1de-ed40-486a-9e37-29c752975c3e tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:40.875910 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-8de7b1de-ed40-486a-9e37-29c752975c3e tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126" status: 200 len: 1521 microversion: 2.1 time: 0.162244 May 30 12:05:40.875910 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 113/232] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:40 2022] GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:05:40.885012 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-3a0d6aa2-0f97-4495-aaaa-bf95bde9b284 tempest-VolumesTestJSON-560123665 tempest-VolumesTestJSON-560123665-project] Calling method '.version_select at 0x7f0ef89998b0>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:40.902751 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-0f00f4b0-8ea8-40c7-8a06-7545658dd31a tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a440b40bc3124bafa502f66a004d0de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7843d3fb7cb402b8a85179da7bfffaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:40.909475 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-0f00f4b0-8ea8-40c7-8a06-7545658dd31a tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] 10.222.0.32 "GET /compute/v2.1/servers/cdfbd2ce-7401-4bde-9410-9ea55f87512d" status: 200 len: 1303 microversion: 2.1 time: 0.112107 May 30 12:05:40.910603 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 120/233] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:40 2022] GET /compute/v2.1/servers/cdfbd2ce-7401-4bde-9410-9ea55f87512d => generated 1303 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:05:40.968663 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-3a0d6aa2-0f97-4495-aaaa-bf95bde9b284 tempest-VolumesTestJSON-560123665 tempest-VolumesTestJSON-560123665-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.091910 May 30 12:05:40.969697 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 114/234] 10.222.0.32 () {58 vars in 1169 bytes} [Mon May 30 12:05:40 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:05:40.982182 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-6eee5ee1-9e77-4bd1-92d4-a7065f5433ee tempest-VolumesTestJSON-560123665 tempest-VolumesTestJSON-560123665-project] Calling method '.version_select at 0x7f0ef89a7d30>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:41.072008 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-6eee5ee1-9e77-4bd1-92d4-a7065f5433ee tempest-VolumesTestJSON-560123665 tempest-VolumesTestJSON-560123665-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.093431 May 30 12:05:41.072761 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 121/235] 10.222.0.32 () {58 vars in 1154 bytes} [Mon May 30 12:05:40 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:05:41.084089 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-dcf408e5-308f-4e85-8d3a-e6b12b1720c9 tempest-VolumesTestJSON-560123665 tempest-VolumesTestJSON-560123665-project] Calling method '.version_select at 0x7f0ef89b50d0>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:41.164482 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-dcf408e5-308f-4e85-8d3a-e6b12b1720c9 tempest-VolumesTestJSON-560123665 tempest-VolumesTestJSON-560123665-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.084049 May 30 12:05:41.165057 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 115/236] 10.222.0.32 () {58 vars in 1187 bytes} [Mon May 30 12:05:41 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 30 12:05:41.177364 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-d6b1327f-5e28-4d23-8b61-93d3e374e272 tempest-VolumesTestJSON-560123665 tempest-VolumesTestJSON-560123665-project] Calling method '.version_select at 0x7f0ef8a4db80>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:41.262335 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-d6b1327f-5e28-4d23-8b61-93d3e374e272 tempest-VolumesTestJSON-560123665 tempest-VolumesTestJSON-560123665-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.088878 May 30 12:05:41.262906 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 122/237] 10.222.0.32 () {58 vars in 1154 bytes} [Mon May 30 12:05:41 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:05:41.893420 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-f8eae6ac-bb23-402e-854c-135e4e4fedb9 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:41.893960 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-f8eae6ac-bb23-402e-854c-135e4e4fedb9 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 8542b17d-0c65-4c5d-bc97-9d17545e2126] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:41.901675 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f8eae6ac-bb23-402e-854c-135e4e4fedb9 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:41.902185 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f8eae6ac-bb23-402e-854c-135e4e4fedb9 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:41.902960 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f8eae6ac-bb23-402e-854c-135e4e4fedb9 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:41.903392 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f8eae6ac-bb23-402e-854c-135e4e4fedb9 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:41.926441 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-1a0f28b7-070f-46f1-a220-66203c3a747e tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:41.927160 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-1a0f28b7-070f-46f1-a220-66203c3a747e tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] [instance: cdfbd2ce-7401-4bde-9410-9ea55f87512d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:41.933580 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1a0f28b7-070f-46f1-a220-66203c3a747e tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:41.933999 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1a0f28b7-070f-46f1-a220-66203c3a747e tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:41.934772 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1a0f28b7-070f-46f1-a220-66203c3a747e tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:41.935251 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1a0f28b7-070f-46f1-a220-66203c3a747e tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:41.951804 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.wsgi [None req-1a0f28b7-070f-46f1-a220-66203c3a747e tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] HTTP exception thrown: Instance cdfbd2ce-7401-4bde-9410-9ea55f87512d could not be found. May 30 12:05:41.954653 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-1a0f28b7-070f-46f1-a220-66203c3a747e tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Request method failure captured: May 30 12:05:41.954653 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: request: GET /compute/v2.1/servers/cdfbd2ce-7401-4bde-9410-9ea55f87512d HTTP/1.1 May 30 12:05:41.954653 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Accept: application/json May 30 12:05:41.954653 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Accept-Encoding: identity May 30 12:05:41.954653 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Connection: close May 30 12:05:41.954653 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Content-Length: 0 May 30 12:05:41.954653 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Content-Type: application/json May 30 12:05:41.954653 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Host: 10.222.0.32 May 30 12:05:41.954653 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Openstack-System-Scope: None May 30 12:05:41.954653 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: User-Agent: python-urllib3/1.26.9 May 30 12:05:41.954653 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Auth-Token: gAAAAABilLMBKaWsMEy-KFPco3Ua5WGHQoMvWvYcTotIy0ScFya8DdKBfTkB0WOQu1HsItYVxz6cX5nY5swUGx4ni0VTMjSWtqm3PSISM6b0-zkMhz8JjfSYN6wNQ15R3dafyF8GGRrWbtg60-E5Ve-ao6KvBgMInQz8bi_qmUDIhBPDQP5W-Qo May 30 12:05:41.954653 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Domain-Id: None May 30 12:05:41.954653 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Domain-Name: None May 30 12:05:41.954653 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Identity-Status: Confirmed May 30 12:05:41.954653 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Is-Admin-Project: True May 30 12:05:41.954653 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Domain-Id: default May 30 12:05:41.954653 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Domain-Name: Default May 30 12:05:41.954653 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Id: b7843d3fb7cb402b8a85179da7bfffaa May 30 12:05:41.954653 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Name: tempest-VolumesActionsTest-578485732 May 30 12:05:41.954653 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Role: reader,member May 30 12:05:41.954653 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Roles: reader,member May 30 12:05:41.956103 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/b7843d3fb7cb402b8a85179da7bfffaa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/b7843d3fb7cb402b8a85179da7bfffaa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/b7843d3fb7cb402b8a85179da7bfffaa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_b7843d3fb7cb402b8a85179da7bfffaa", "adminURL": "http://10.222.0.32:8080"}]}] May 30 12:05:41.956103 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Tenant: tempest-VolumesActionsTest-578485732 May 30 12:05:41.956103 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Tenant-Id: b7843d3fb7cb402b8a85179da7bfffaa May 30 12:05:41.956103 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Tenant-Name: tempest-VolumesActionsTest-578485732 May 30 12:05:41.956103 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User: tempest-VolumesActionsTest-578485732-project May 30 12:05:41.956103 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Domain-Id: default May 30 12:05:41.956103 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Domain-Name: Default May 30 12:05:41.956103 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Id: a440b40bc3124bafa502f66a004d0de0 May 30 12:05:41.956103 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Name: tempest-VolumesActionsTest-578485732-project May 30 12:05:41.956103 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: method: > May 30 12:05:41.956103 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: exception: Instance cdfbd2ce-7401-4bde-9410-9ea55f87512d could not be found. May 30 12:05:41.956103 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: action_args: {'id': 'cdfbd2ce-7401-4bde-9410-9ea55f87512d'} May 30 12:05:41.957039 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:05:41.957039 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:05:41.957039 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:05:41.957039 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:05:41.957039 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:05:41.957039 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:05:41.957039 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:05:41.957039 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:05:41.957039 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:05:41.957039 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:05:41.957039 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdfbd2ce-7401-4bde-9410-9ea55f87512d could not be found. May 30 12:05:41.957039 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:05:41.957039 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:05:41.957039 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:05:41.957039 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:05:41.957039 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:05:41.957039 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:05:41.957039 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:05:41.957039 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:05:41.957039 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:05:41.958601 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:05:41.958601 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 30 12:05:41.958601 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 30 12:05:41.958601 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 30 12:05:41.958601 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 30 12:05:41.958601 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:05:41.958601 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:05:41.958601 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdfbd2ce-7401-4bde-9410-9ea55f87512d could not be found. May 30 12:05:41.958601 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:05:41.958601 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:05:41.958601 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:05:41.958601 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:05:41.958601 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:05:41.958601 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:05:41.958601 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:05:41.958601 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:05:41.958601 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdfbd2ce-7401-4bde-9410-9ea55f87512d could not be found. May 30 12:05:41.958601 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:05:41.959593 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-1a0f28b7-070f-46f1-a220-66203c3a747e tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Returning 404 to user: Instance cdfbd2ce-7401-4bde-9410-9ea55f87512d could not be found. {{(pid=117671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:05:41.959593 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-1a0f28b7-070f-46f1-a220-66203c3a747e tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] 10.222.0.32 "GET /compute/v2.1/servers/cdfbd2ce-7401-4bde-9410-9ea55f87512d" status: 404 len: 111 microversion: 2.1 time: 0.033961 May 30 12:05:41.959593 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 123/238] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:41 2022] GET /compute/v2.1/servers/cdfbd2ce-7401-4bde-9410-9ea55f87512d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 30 12:05:42.039655 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-f8eae6ac-bb23-402e-854c-135e4e4fedb9 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:42.047643 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-f8eae6ac-bb23-402e-854c-135e4e4fedb9 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126" status: 200 len: 1501 microversion: 2.1 time: 0.158597 May 30 12:05:42.048437 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 116/239] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:41 2022] GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126 => generated 1501 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:05:42.059953 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-4e0e8459-8fe0-4ab7-87d3-57a0694991be tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-416280384", "imageRef": "b8ef93ed-af98-4d8c-9e1d-43d7b1f2b832", "flavorRef": "452", "networks": [{"uuid": "d20fda1c-0652-4fa5-b0ab-44f416d9d703"}]}} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:05:42.067270 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-f78443dd-e13f-47c0-b91e-256c60809ed2 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:42.068439 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-f78443dd-e13f-47c0-b91e-256c60809ed2 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: dcdae5e3-81e8-412d-9e2a-0a481c13b57b] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:42.074957 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f78443dd-e13f-47c0-b91e-256c60809ed2 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:42.075396 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f78443dd-e13f-47c0-b91e-256c60809ed2 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:42.076179 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f78443dd-e13f-47c0-b91e-256c60809ed2 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:42.076619 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f78443dd-e13f-47c0-b91e-256c60809ed2 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:42.114901 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.network.neutron [None req-4e0e8459-8fe0-4ab7-87d3-57a0694991be tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] validate_networks() for [('d20fda1c-0652-4fa5-b0ab-44f416d9d703', None, None, None, None, None)] {{(pid=117671) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 30 12:05:42.323290 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-f78443dd-e13f-47c0-b91e-256c60809ed2 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:42.333306 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-f78443dd-e13f-47c0-b91e-256c60809ed2 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b" status: 200 len: 1516 microversion: 2.1 time: 0.273266 May 30 12:05:42.333892 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 117/240] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:42 2022] GET /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b => generated 1516 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:05:42.608292 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-4e0e8459-8fe0-4ab7-87d3-57a0694991be tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Flavor limits 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 30 12:05:42.608723 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-4e0e8459-8fe0-4ab7-87d3-57a0694991be tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Image limits 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 30 12:05:42.609197 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-4e0e8459-8fe0-4ab7-87d3-57a0694991be tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Flavor pref 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 30 12:05:42.610468 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-4e0e8459-8fe0-4ab7-87d3-57a0694991be tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Image pref 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 30 12:05:42.611081 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-4e0e8459-8fe0-4ab7-87d3-57a0694991be tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 30 12:05:42.623377 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4e0e8459-8fe0-4ab7-87d3-57a0694991be tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:42.623587 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4e0e8459-8fe0-4ab7-87d3-57a0694991be tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:42.624793 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4e0e8459-8fe0-4ab7-87d3-57a0694991be tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:42.625647 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4e0e8459-8fe0-4ab7-87d3-57a0694991be tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:42.650821 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.quota [None req-4e0e8459-8fe0-4ab7-87d3-57a0694991be tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Getting quotas for project b7843d3fb7cb402b8a85179da7bfffaa. Resources: {'cores', 'instances', 'ram'} {{(pid=117671) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 30 12:05:42.662227 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.quota [None req-4e0e8459-8fe0-4ab7-87d3-57a0694991be tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Getting quotas for user a440b40bc3124bafa502f66a004d0de0 and project b7843d3fb7cb402b8a85179da7bfffaa. Resources: {'cores', 'instances', 'ram'} {{(pid=117671) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 30 12:05:42.677688 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-4e0e8459-8fe0-4ab7-87d3-57a0694991be tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Going to run 1 instances... {{(pid=117671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 30 12:05:42.681309 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-4e0e8459-8fe0-4ab7-87d3-57a0694991be tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] [instance: 3d315266-d4ca-49dd-a23a-422ff48316a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b8ef93ed-af98-4d8c-9e1d-43d7b1f2b832',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 30 12:05:42.754292 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-4e0e8459-8fe0-4ab7-87d3-57a0694991be tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.698390 May 30 12:05:42.754938 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 124/241] 10.222.0.32 () {60 vars in 1146 bytes} [Mon May 30 12:05:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 700 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 30 12:05:42.771975 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-013da5e2-7130-46b5-94bf-5979e80c22ed tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:42.773151 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-013da5e2-7130-46b5-94bf-5979e80c22ed tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] [instance: 3d315266-d4ca-49dd-a23a-422ff48316a9] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:42.842048 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-013da5e2-7130-46b5-94bf-5979e80c22ed tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a440b40bc3124bafa502f66a004d0de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7843d3fb7cb402b8a85179da7bfffaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:42.849534 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-013da5e2-7130-46b5-94bf-5979e80c22ed tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] 10.222.0.32 "GET /compute/v2.1/servers/3d315266-d4ca-49dd-a23a-422ff48316a9" status: 200 len: 1213 microversion: 2.1 time: 0.088449 May 30 12:05:42.850139 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 118/242] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:42 2022] GET /compute/v2.1/servers/3d315266-d4ca-49dd-a23a-422ff48316a9 => generated 1213 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:05:43.780345 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-19bbfe42-00ea-4630-ae86-d643b9a2f3d9 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:05:43.782196 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-19bbfe42-00ea-4630-ae86-d643b9a2f3d9 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: dcdae5e3-81e8-412d-9e2a-0a481c13b57b] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:43.789119 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-19bbfe42-00ea-4630-ae86-d643b9a2f3d9 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:43.789511 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-19bbfe42-00ea-4630-ae86-d643b9a2f3d9 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:43.790274 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-19bbfe42-00ea-4630-ae86-d643b9a2f3d9 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:43.790716 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-19bbfe42-00ea-4630-ae86-d643b9a2f3d9 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:43.813161 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.objects.instance [None req-19bbfe42-00ea-4630-ae86-d643b9a2f3d9 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lazy-loading 'flavor' on Instance uuid dcdae5e3-81e8-412d-9e2a-0a481c13b57b {{(pid=117671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 30 12:05:43.867638 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-1a5b887b-cff8-4d91-8235-0af8272e8707 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:43.868429 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-1a5b887b-cff8-4d91-8235-0af8272e8707 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] [instance: 3d315266-d4ca-49dd-a23a-422ff48316a9] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:43.875470 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1a5b887b-cff8-4d91-8235-0af8272e8707 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:43.875934 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1a5b887b-cff8-4d91-8235-0af8272e8707 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:43.876744 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1a5b887b-cff8-4d91-8235-0af8272e8707 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:43.877260 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1a5b887b-cff8-4d91-8235-0af8272e8707 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:43.887758 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-19bbfe42-00ea-4630-ae86-d643b9a2f3d9 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "POST /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b/action" status: 200 len: 32 microversion: 2.1 time: 0.111371 May 30 12:05:43.888532 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 125/243] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 30 12:05:43 2022] POST /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b/action => generated 32 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 30 12:05:43.898577 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-532900d9-90de-48eb-bc1c-6c2a3a6c83ce tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:43.899284 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-532900d9-90de-48eb-bc1c-6c2a3a6c83ce tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: dcdae5e3-81e8-412d-9e2a-0a481c13b57b] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:43.905949 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-532900d9-90de-48eb-bc1c-6c2a3a6c83ce tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:43.907239 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-532900d9-90de-48eb-bc1c-6c2a3a6c83ce tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:43.908214 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-532900d9-90de-48eb-bc1c-6c2a3a6c83ce tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:43.908653 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-532900d9-90de-48eb-bc1c-6c2a3a6c83ce tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:43.941623 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-1a5b887b-cff8-4d91-8235-0af8272e8707 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a440b40bc3124bafa502f66a004d0de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7843d3fb7cb402b8a85179da7bfffaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:43.949326 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-1a5b887b-cff8-4d91-8235-0af8272e8707 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] 10.222.0.32 "GET /compute/v2.1/servers/3d315266-d4ca-49dd-a23a-422ff48316a9" status: 200 len: 1265 microversion: 2.1 time: 0.086429 May 30 12:05:43.949899 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 119/244] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:43 2022] GET /compute/v2.1/servers/3d315266-d4ca-49dd-a23a-422ff48316a9 => generated 1265 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:05:44.044339 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-532900d9-90de-48eb-bc1c-6c2a3a6c83ce tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:44.052777 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-532900d9-90de-48eb-bc1c-6c2a3a6c83ce tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b" status: 200 len: 1522 microversion: 2.1 time: 0.158464 May 30 12:05:44.053349 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 126/245] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:43 2022] GET /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:05:44.967352 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-5a596e35-dc73-4d50-b5a1-01c2426ccd35 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:44.967950 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-5a596e35-dc73-4d50-b5a1-01c2426ccd35 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] [instance: 3d315266-d4ca-49dd-a23a-422ff48316a9] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:44.974679 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5a596e35-dc73-4d50-b5a1-01c2426ccd35 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:44.975128 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5a596e35-dc73-4d50-b5a1-01c2426ccd35 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:44.975893 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5a596e35-dc73-4d50-b5a1-01c2426ccd35 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:44.976365 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5a596e35-dc73-4d50-b5a1-01c2426ccd35 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:45.041687 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-5a596e35-dc73-4d50-b5a1-01c2426ccd35 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a440b40bc3124bafa502f66a004d0de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7843d3fb7cb402b8a85179da7bfffaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:45.049887 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-5a596e35-dc73-4d50-b5a1-01c2426ccd35 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] 10.222.0.32 "GET /compute/v2.1/servers/3d315266-d4ca-49dd-a23a-422ff48316a9" status: 200 len: 1265 microversion: 2.1 time: 0.086350 May 30 12:05:45.050447 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 120/246] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:44 2022] GET /compute/v2.1/servers/3d315266-d4ca-49dd-a23a-422ff48316a9 => generated 1265 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:05:45.070626 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-3d567901-8c6b-4493-b06d-b7904411ec98 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:45.071227 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-3d567901-8c6b-4493-b06d-b7904411ec98 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: dcdae5e3-81e8-412d-9e2a-0a481c13b57b] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:45.077561 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3d567901-8c6b-4493-b06d-b7904411ec98 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:45.078036 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3d567901-8c6b-4493-b06d-b7904411ec98 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:45.079421 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3d567901-8c6b-4493-b06d-b7904411ec98 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:45.079850 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3d567901-8c6b-4493-b06d-b7904411ec98 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:45.215701 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-3d567901-8c6b-4493-b06d-b7904411ec98 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:45.224973 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-3d567901-8c6b-4493-b06d-b7904411ec98 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b" status: 200 len: 1522 microversion: 2.1 time: 0.157617 May 30 12:05:45.225962 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 127/247] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:45 2022] GET /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:05:46.067026 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-7b467352-99ca-45c0-bda6-956593d96bd2 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:46.067630 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-7b467352-99ca-45c0-bda6-956593d96bd2 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] [instance: 3d315266-d4ca-49dd-a23a-422ff48316a9] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:46.074515 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7b467352-99ca-45c0-bda6-956593d96bd2 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:46.074975 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7b467352-99ca-45c0-bda6-956593d96bd2 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:46.075744 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7b467352-99ca-45c0-bda6-956593d96bd2 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:46.076293 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7b467352-99ca-45c0-bda6-956593d96bd2 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:46.140255 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-7b467352-99ca-45c0-bda6-956593d96bd2 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a440b40bc3124bafa502f66a004d0de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7843d3fb7cb402b8a85179da7bfffaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:46.148771 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-7b467352-99ca-45c0-bda6-956593d96bd2 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] 10.222.0.32 "GET /compute/v2.1/servers/3d315266-d4ca-49dd-a23a-422ff48316a9" status: 200 len: 1265 microversion: 2.1 time: 0.085964 May 30 12:05:46.149359 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 121/248] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:46 2022] GET /compute/v2.1/servers/3d315266-d4ca-49dd-a23a-422ff48316a9 => generated 1265 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:05:46.243553 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-45b5beef-6763-4071-9c5e-f288adc433a6 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:46.244176 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-45b5beef-6763-4071-9c5e-f288adc433a6 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: dcdae5e3-81e8-412d-9e2a-0a481c13b57b] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:46.250309 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-45b5beef-6763-4071-9c5e-f288adc433a6 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:46.250910 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-45b5beef-6763-4071-9c5e-f288adc433a6 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:46.251665 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-45b5beef-6763-4071-9c5e-f288adc433a6 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:46.252094 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-45b5beef-6763-4071-9c5e-f288adc433a6 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:46.406621 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-45b5beef-6763-4071-9c5e-f288adc433a6 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:46.415492 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-45b5beef-6763-4071-9c5e-f288adc433a6 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b" status: 200 len: 1522 microversion: 2.1 time: 0.175598 May 30 12:05:46.416066 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 128/249] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:46 2022] GET /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:05:47.166717 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-5b7cb7ae-e161-4698-b3f6-58c7a3589449 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:47.167676 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-5b7cb7ae-e161-4698-b3f6-58c7a3589449 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] [instance: 3d315266-d4ca-49dd-a23a-422ff48316a9] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:47.176757 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5b7cb7ae-e161-4698-b3f6-58c7a3589449 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:47.177206 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5b7cb7ae-e161-4698-b3f6-58c7a3589449 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:47.178276 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5b7cb7ae-e161-4698-b3f6-58c7a3589449 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:47.178724 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5b7cb7ae-e161-4698-b3f6-58c7a3589449 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:47.249601 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-5b7cb7ae-e161-4698-b3f6-58c7a3589449 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a440b40bc3124bafa502f66a004d0de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7843d3fb7cb402b8a85179da7bfffaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:47.258879 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-5b7cb7ae-e161-4698-b3f6-58c7a3589449 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] 10.222.0.32 "GET /compute/v2.1/servers/3d315266-d4ca-49dd-a23a-422ff48316a9" status: 200 len: 1271 microversion: 2.1 time: 0.096452 May 30 12:05:47.271338 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 122/250] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:47 2022] GET /compute/v2.1/servers/3d315266-d4ca-49dd-a23a-422ff48316a9 => generated 1271 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:05:47.434024 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-830cfdb4-c10b-43b0-ad87-9e83888994f0 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:47.435135 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-830cfdb4-c10b-43b0-ad87-9e83888994f0 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: dcdae5e3-81e8-412d-9e2a-0a481c13b57b] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:47.441810 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-830cfdb4-c10b-43b0-ad87-9e83888994f0 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:47.442261 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-830cfdb4-c10b-43b0-ad87-9e83888994f0 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:47.443041 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-830cfdb4-c10b-43b0-ad87-9e83888994f0 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:47.443647 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-830cfdb4-c10b-43b0-ad87-9e83888994f0 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:47.585990 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-830cfdb4-c10b-43b0-ad87-9e83888994f0 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:47.593965 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-830cfdb4-c10b-43b0-ad87-9e83888994f0 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b" status: 200 len: 1522 microversion: 2.1 time: 0.164224 May 30 12:05:47.595779 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 129/251] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:47 2022] GET /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:05:48.221054 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-351c6886-1534-46c2-9466-ed0faa0dc526 req-404e94c7-f51b-4207-9c58-35e6719766d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d315266-d4ca-49dd-a23a-422ff48316a9", "tag": "2ca8fe76-2bd8-47a7-b548-22fe3095f649"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:05:48.231780 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-351c6886-1534-46c2-9466-ed0faa0dc526 req-404e94c7-f51b-4207-9c58-35e6719766d0 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:48.232499 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-351c6886-1534-46c2-9466-ed0faa0dc526 req-404e94c7-f51b-4207-9c58-35e6719766d0 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:48.245562 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-351c6886-1534-46c2-9466-ed0faa0dc526 req-404e94c7-f51b-4207-9c58-35e6719766d0 service nova] Creating event network-changed:2ca8fe76-2bd8-47a7-b548-22fe3095f649 for instance 3d315266-d4ca-49dd-a23a-422ff48316a9 on hv-cinder-84051 May 30 12:05:48.250642 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-351c6886-1534-46c2-9466-ed0faa0dc526 req-404e94c7-f51b-4207-9c58-35e6719766d0 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035700 May 30 12:05:48.251378 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 123/252] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:05:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:05:48.277079 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-dc14b0b0-6e3b-43aa-8fe8-a36e64842ff1 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:48.277841 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-dc14b0b0-6e3b-43aa-8fe8-a36e64842ff1 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] [instance: 3d315266-d4ca-49dd-a23a-422ff48316a9] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:48.285162 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-dc14b0b0-6e3b-43aa-8fe8-a36e64842ff1 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:48.285883 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-dc14b0b0-6e3b-43aa-8fe8-a36e64842ff1 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:48.286846 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-dc14b0b0-6e3b-43aa-8fe8-a36e64842ff1 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:48.287278 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-dc14b0b0-6e3b-43aa-8fe8-a36e64842ff1 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:48.529805 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-dc14b0b0-6e3b-43aa-8fe8-a36e64842ff1 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a440b40bc3124bafa502f66a004d0de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7843d3fb7cb402b8a85179da7bfffaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:48.539575 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-dc14b0b0-6e3b-43aa-8fe8-a36e64842ff1 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] 10.222.0.32 "GET /compute/v2.1/servers/3d315266-d4ca-49dd-a23a-422ff48316a9" status: 200 len: 1313 microversion: 2.1 time: 0.266387 May 30 12:05:48.540877 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 130/253] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:48 2022] GET /compute/v2.1/servers/3d315266-d4ca-49dd-a23a-422ff48316a9 => generated 1313 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:05:48.613111 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-6b5c0af2-1489-40f5-928a-2e32efd35208 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:48.614302 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-6b5c0af2-1489-40f5-928a-2e32efd35208 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: dcdae5e3-81e8-412d-9e2a-0a481c13b57b] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:48.621090 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6b5c0af2-1489-40f5-928a-2e32efd35208 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:48.621889 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6b5c0af2-1489-40f5-928a-2e32efd35208 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:48.622900 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6b5c0af2-1489-40f5-928a-2e32efd35208 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:48.623549 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6b5c0af2-1489-40f5-928a-2e32efd35208 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:48.797272 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-6b5c0af2-1489-40f5-928a-2e32efd35208 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:48.809984 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-6b5c0af2-1489-40f5-928a-2e32efd35208 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b" status: 200 len: 1522 microversion: 2.1 time: 0.198108 May 30 12:05:48.809984 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 124/254] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:48 2022] GET /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:05:49.557973 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-1f743a74-5c3d-40f3-a6a2-f27c65fe2b6b tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:49.558585 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-1f743a74-5c3d-40f3-a6a2-f27c65fe2b6b tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] [instance: 3d315266-d4ca-49dd-a23a-422ff48316a9] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:49.565598 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1f743a74-5c3d-40f3-a6a2-f27c65fe2b6b tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:49.565824 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1f743a74-5c3d-40f3-a6a2-f27c65fe2b6b tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:49.566406 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1f743a74-5c3d-40f3-a6a2-f27c65fe2b6b tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:49.566834 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1f743a74-5c3d-40f3-a6a2-f27c65fe2b6b tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:49.708573 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-1f743a74-5c3d-40f3-a6a2-f27c65fe2b6b tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a440b40bc3124bafa502f66a004d0de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7843d3fb7cb402b8a85179da7bfffaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:49.719122 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-1f743a74-5c3d-40f3-a6a2-f27c65fe2b6b tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] 10.222.0.32 "GET /compute/v2.1/servers/3d315266-d4ca-49dd-a23a-422ff48316a9" status: 200 len: 1313 microversion: 2.1 time: 0.164868 May 30 12:05:49.719956 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 131/255] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:49 2022] GET /compute/v2.1/servers/3d315266-d4ca-49dd-a23a-422ff48316a9 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:05:49.823813 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-c00e466e-fc3a-450e-9b93-21c715031d6d tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:49.824464 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-c00e466e-fc3a-450e-9b93-21c715031d6d tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: dcdae5e3-81e8-412d-9e2a-0a481c13b57b] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:49.831349 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c00e466e-fc3a-450e-9b93-21c715031d6d tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:49.831895 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c00e466e-fc3a-450e-9b93-21c715031d6d tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:49.832716 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c00e466e-fc3a-450e-9b93-21c715031d6d tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:49.833155 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c00e466e-fc3a-450e-9b93-21c715031d6d tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:49.973410 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-c00e466e-fc3a-450e-9b93-21c715031d6d tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:49.981896 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-c00e466e-fc3a-450e-9b93-21c715031d6d tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b" status: 200 len: 1522 microversion: 2.1 time: 0.161959 May 30 12:05:49.983320 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 125/256] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:49 2022] GET /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:05:50.736177 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-30613d41-176b-42e6-b978-dd4ce76db4cd tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:50.736812 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-30613d41-176b-42e6-b978-dd4ce76db4cd tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] [instance: 3d315266-d4ca-49dd-a23a-422ff48316a9] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:50.742946 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-30613d41-176b-42e6-b978-dd4ce76db4cd tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:50.743392 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-30613d41-176b-42e6-b978-dd4ce76db4cd tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:50.744167 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-30613d41-176b-42e6-b978-dd4ce76db4cd tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:50.744618 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-30613d41-176b-42e6-b978-dd4ce76db4cd tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:50.876429 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-30613d41-176b-42e6-b978-dd4ce76db4cd tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a440b40bc3124bafa502f66a004d0de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7843d3fb7cb402b8a85179da7bfffaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:50.884033 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-30613d41-176b-42e6-b978-dd4ce76db4cd tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] 10.222.0.32 "GET /compute/v2.1/servers/3d315266-d4ca-49dd-a23a-422ff48316a9" status: 200 len: 1313 microversion: 2.1 time: 0.151921 May 30 12:05:50.884646 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 132/257] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:50 2022] GET /compute/v2.1/servers/3d315266-d4ca-49dd-a23a-422ff48316a9 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:05:51.001361 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-2b5b76a8-4983-4f90-8980-1b6b22fa9335 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:51.001971 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-2b5b76a8-4983-4f90-8980-1b6b22fa9335 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: dcdae5e3-81e8-412d-9e2a-0a481c13b57b] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:51.008459 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2b5b76a8-4983-4f90-8980-1b6b22fa9335 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:51.008907 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2b5b76a8-4983-4f90-8980-1b6b22fa9335 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:51.009660 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2b5b76a8-4983-4f90-8980-1b6b22fa9335 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:51.010092 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2b5b76a8-4983-4f90-8980-1b6b22fa9335 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:51.140050 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-2b5b76a8-4983-4f90-8980-1b6b22fa9335 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:51.148843 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-2b5b76a8-4983-4f90-8980-1b6b22fa9335 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b" status: 200 len: 1522 microversion: 2.1 time: 0.152180 May 30 12:05:51.149413 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 126/258] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:50 2022] GET /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:05:51.904739 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-f66d4411-f36c-496e-832c-e2a87f83c307 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:51.905675 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-f66d4411-f36c-496e-832c-e2a87f83c307 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] [instance: 3d315266-d4ca-49dd-a23a-422ff48316a9] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:51.915194 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f66d4411-f36c-496e-832c-e2a87f83c307 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:51.915810 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f66d4411-f36c-496e-832c-e2a87f83c307 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:51.917024 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f66d4411-f36c-496e-832c-e2a87f83c307 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:51.917688 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f66d4411-f36c-496e-832c-e2a87f83c307 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:52.058238 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-f66d4411-f36c-496e-832c-e2a87f83c307 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a440b40bc3124bafa502f66a004d0de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7843d3fb7cb402b8a85179da7bfffaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:52.066527 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-f66d4411-f36c-496e-832c-e2a87f83c307 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] 10.222.0.32 "GET /compute/v2.1/servers/3d315266-d4ca-49dd-a23a-422ff48316a9" status: 200 len: 1313 microversion: 2.1 time: 0.168045 May 30 12:05:52.067091 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 133/259] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:51 2022] GET /compute/v2.1/servers/3d315266-d4ca-49dd-a23a-422ff48316a9 => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:05:52.164777 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-869333e0-8d0c-4dc7-8bd9-3767dde648a2 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:52.165457 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-869333e0-8d0c-4dc7-8bd9-3767dde648a2 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: dcdae5e3-81e8-412d-9e2a-0a481c13b57b] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:52.172111 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-869333e0-8d0c-4dc7-8bd9-3767dde648a2 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:52.172609 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-869333e0-8d0c-4dc7-8bd9-3767dde648a2 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:52.173374 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-869333e0-8d0c-4dc7-8bd9-3767dde648a2 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:52.173912 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-869333e0-8d0c-4dc7-8bd9-3767dde648a2 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:52.196313 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell1:SELECT=100 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:05:52.326529 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-869333e0-8d0c-4dc7-8bd9-3767dde648a2 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:52.335188 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-869333e0-8d0c-4dc7-8bd9-3767dde648a2 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b" status: 200 len: 1522 microversion: 2.1 time: 0.174078 May 30 12:05:52.335873 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 127/260] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:52 2022] GET /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:05:53.085142 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-59aaa893-b57b-4ba3-9015-741aadb9b1cd tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:53.085751 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-59aaa893-b57b-4ba3-9015-741aadb9b1cd tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] [instance: 3d315266-d4ca-49dd-a23a-422ff48316a9] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:53.087703 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell0:SELECT=2 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:05:53.088386 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell0:SELECT=6 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:05:53.095635 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-59aaa893-b57b-4ba3-9015-741aadb9b1cd tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:53.096082 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-59aaa893-b57b-4ba3-9015-741aadb9b1cd tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:53.096900 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-59aaa893-b57b-4ba3-9015-741aadb9b1cd tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:53.097339 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-59aaa893-b57b-4ba3-9015-741aadb9b1cd tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:53.225181 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-59aaa893-b57b-4ba3-9015-741aadb9b1cd tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a440b40bc3124bafa502f66a004d0de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7843d3fb7cb402b8a85179da7bfffaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:53.232650 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-59aaa893-b57b-4ba3-9015-741aadb9b1cd tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] 10.222.0.32 "GET /compute/v2.1/servers/3d315266-d4ca-49dd-a23a-422ff48316a9" status: 200 len: 1313 microversion: 2.1 time: 0.151684 May 30 12:05:53.233217 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 134/261] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:53 2022] GET /compute/v2.1/servers/3d315266-d4ca-49dd-a23a-422ff48316a9 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:05:53.354285 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-f9e8b5aa-e714-4835-95c4-54c1cd270094 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:53.354891 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-f9e8b5aa-e714-4835-95c4-54c1cd270094 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: dcdae5e3-81e8-412d-9e2a-0a481c13b57b] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:53.356745 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell0:SELECT=2 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:05:53.357869 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:05:53.364111 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f9e8b5aa-e714-4835-95c4-54c1cd270094 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:53.364582 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f9e8b5aa-e714-4835-95c4-54c1cd270094 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:53.365342 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f9e8b5aa-e714-4835-95c4-54c1cd270094 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:53.365772 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f9e8b5aa-e714-4835-95c4-54c1cd270094 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:53.501397 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-f9e8b5aa-e714-4835-95c4-54c1cd270094 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:53.508956 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-f9e8b5aa-e714-4835-95c4-54c1cd270094 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b" status: 200 len: 1522 microversion: 2.1 time: 0.158555 May 30 12:05:53.509513 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 128/262] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:53 2022] GET /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:05:54.250602 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-0603a718-a651-4dd9-acb2-3e34f74e7ae6 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:54.251245 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-0603a718-a651-4dd9-acb2-3e34f74e7ae6 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] [instance: 3d315266-d4ca-49dd-a23a-422ff48316a9] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:54.253948 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:05:54.260909 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0603a718-a651-4dd9-acb2-3e34f74e7ae6 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:54.261350 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0603a718-a651-4dd9-acb2-3e34f74e7ae6 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:54.262108 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0603a718-a651-4dd9-acb2-3e34f74e7ae6 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:54.262533 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0603a718-a651-4dd9-acb2-3e34f74e7ae6 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:54.392246 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-0603a718-a651-4dd9-acb2-3e34f74e7ae6 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a440b40bc3124bafa502f66a004d0de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7843d3fb7cb402b8a85179da7bfffaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:54.399979 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-0603a718-a651-4dd9-acb2-3e34f74e7ae6 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] 10.222.0.32 "GET /compute/v2.1/servers/3d315266-d4ca-49dd-a23a-422ff48316a9" status: 200 len: 1313 microversion: 2.1 time: 0.153998 May 30 12:05:54.400586 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 135/263] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:54 2022] GET /compute/v2.1/servers/3d315266-d4ca-49dd-a23a-422ff48316a9 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:05:54.526555 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-aa93a7a5-93d2-4d36-86b8-786768acfec5 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:54.527291 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-aa93a7a5-93d2-4d36-86b8-786768acfec5 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: dcdae5e3-81e8-412d-9e2a-0a481c13b57b] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:54.534186 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-aa93a7a5-93d2-4d36-86b8-786768acfec5 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:54.534640 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-aa93a7a5-93d2-4d36-86b8-786768acfec5 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:54.535423 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-aa93a7a5-93d2-4d36-86b8-786768acfec5 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:54.535865 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-aa93a7a5-93d2-4d36-86b8-786768acfec5 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:54.670018 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-aa93a7a5-93d2-4d36-86b8-786768acfec5 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:54.678403 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-aa93a7a5-93d2-4d36-86b8-786768acfec5 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b" status: 200 len: 1522 microversion: 2.1 time: 0.155903 May 30 12:05:54.678971 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 129/264] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:54 2022] GET /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:05:55.417004 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-fffc54d7-93d6-4e35-9d8a-a48d06ee1e2f tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:55.417516 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-fffc54d7-93d6-4e35-9d8a-a48d06ee1e2f tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] [instance: 3d315266-d4ca-49dd-a23a-422ff48316a9] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:55.423646 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-fffc54d7-93d6-4e35-9d8a-a48d06ee1e2f tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:55.424092 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-fffc54d7-93d6-4e35-9d8a-a48d06ee1e2f tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:55.424883 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-fffc54d7-93d6-4e35-9d8a-a48d06ee1e2f tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:55.425310 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-fffc54d7-93d6-4e35-9d8a-a48d06ee1e2f tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:55.557755 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-fffc54d7-93d6-4e35-9d8a-a48d06ee1e2f tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a440b40bc3124bafa502f66a004d0de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7843d3fb7cb402b8a85179da7bfffaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:55.560229 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:05:55.567992 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-fffc54d7-93d6-4e35-9d8a-a48d06ee1e2f tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] 10.222.0.32 "GET /compute/v2.1/servers/3d315266-d4ca-49dd-a23a-422ff48316a9" status: 200 len: 1313 microversion: 2.1 time: 0.154837 May 30 12:05:55.568913 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 136/265] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:55 2022] GET /compute/v2.1/servers/3d315266-d4ca-49dd-a23a-422ff48316a9 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:05:55.696089 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-4a354b96-5d69-45b9-b1c4-5e401ae9e20a tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:55.696946 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-4a354b96-5d69-45b9-b1c4-5e401ae9e20a tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: dcdae5e3-81e8-412d-9e2a-0a481c13b57b] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:55.703970 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4a354b96-5d69-45b9-b1c4-5e401ae9e20a tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:55.704439 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4a354b96-5d69-45b9-b1c4-5e401ae9e20a tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:55.705210 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4a354b96-5d69-45b9-b1c4-5e401ae9e20a tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:55.705647 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4a354b96-5d69-45b9-b1c4-5e401ae9e20a tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:55.851169 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-4a354b96-5d69-45b9-b1c4-5e401ae9e20a tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:55.858697 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-4a354b96-5d69-45b9-b1c4-5e401ae9e20a tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b" status: 200 len: 1522 microversion: 2.1 time: 0.166526 May 30 12:05:55.859257 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 130/266] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:55 2022] GET /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:05:56.586339 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-3fd168a7-fb92-4ada-a6be-5de4abfba103 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:56.586978 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-3fd168a7-fb92-4ada-a6be-5de4abfba103 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] [instance: 3d315266-d4ca-49dd-a23a-422ff48316a9] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:56.595536 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3fd168a7-fb92-4ada-a6be-5de4abfba103 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:56.595683 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3fd168a7-fb92-4ada-a6be-5de4abfba103 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:56.596478 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3fd168a7-fb92-4ada-a6be-5de4abfba103 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:56.596905 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3fd168a7-fb92-4ada-a6be-5de4abfba103 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:56.734023 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-3fd168a7-fb92-4ada-a6be-5de4abfba103 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a440b40bc3124bafa502f66a004d0de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7843d3fb7cb402b8a85179da7bfffaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:56.741570 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-3fd168a7-fb92-4ada-a6be-5de4abfba103 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] 10.222.0.32 "GET /compute/v2.1/servers/3d315266-d4ca-49dd-a23a-422ff48316a9" status: 200 len: 1313 microversion: 2.1 time: 0.159878 May 30 12:05:56.742151 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 137/267] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:56 2022] GET /compute/v2.1/servers/3d315266-d4ca-49dd-a23a-422ff48316a9 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:05:56.876793 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-6b0cff83-62e6-433c-a29d-2d1590552087 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:56.877450 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-6b0cff83-62e6-433c-a29d-2d1590552087 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: dcdae5e3-81e8-412d-9e2a-0a481c13b57b] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:56.884652 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6b0cff83-62e6-433c-a29d-2d1590552087 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:56.885106 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6b0cff83-62e6-433c-a29d-2d1590552087 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:56.885884 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6b0cff83-62e6-433c-a29d-2d1590552087 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:56.886322 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6b0cff83-62e6-433c-a29d-2d1590552087 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:57.024401 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-6b0cff83-62e6-433c-a29d-2d1590552087 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:57.032113 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-6b0cff83-62e6-433c-a29d-2d1590552087 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b" status: 200 len: 1522 microversion: 2.1 time: 0.159865 May 30 12:05:57.032720 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 131/268] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:56 2022] GET /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:05:57.761406 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-5639a4b2-c1c1-47d6-8b14-5e4e432069b1 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:57.762624 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-76f3fafb-3b54-40d3-8ac9-4ca10604b89f req-23c5c539-475d-4d25-b1d5-ee077f01b069 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d315266-d4ca-49dd-a23a-422ff48316a9", "name": "network-vif-plugged", "status": "completed", "tag": "2ca8fe76-2bd8-47a7-b548-22fe3095f649"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:05:57.764254 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-5639a4b2-c1c1-47d6-8b14-5e4e432069b1 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] [instance: 3d315266-d4ca-49dd-a23a-422ff48316a9] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:57.777377 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5639a4b2-c1c1-47d6-8b14-5e4e432069b1 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:57.777835 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5639a4b2-c1c1-47d6-8b14-5e4e432069b1 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:57.778610 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5639a4b2-c1c1-47d6-8b14-5e4e432069b1 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:57.779051 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5639a4b2-c1c1-47d6-8b14-5e4e432069b1 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:57.788310 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-76f3fafb-3b54-40d3-8ac9-4ca10604b89f req-23c5c539-475d-4d25-b1d5-ee077f01b069 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:57.788958 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-76f3fafb-3b54-40d3-8ac9-4ca10604b89f req-23c5c539-475d-4d25-b1d5-ee077f01b069 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:57.818519 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-76f3fafb-3b54-40d3-8ac9-4ca10604b89f req-23c5c539-475d-4d25-b1d5-ee077f01b069 service nova] Creating event network-vif-plugged:2ca8fe76-2bd8-47a7-b548-22fe3095f649 for instance 3d315266-d4ca-49dd-a23a-422ff48316a9 on hv-cinder-84051 May 30 12:05:57.825942 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-76f3fafb-3b54-40d3-8ac9-4ca10604b89f req-23c5c539-475d-4d25-b1d5-ee077f01b069 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073942 May 30 12:05:57.826768 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 138/269] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:05:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:05:57.993470 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-5639a4b2-c1c1-47d6-8b14-5e4e432069b1 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a440b40bc3124bafa502f66a004d0de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7843d3fb7cb402b8a85179da7bfffaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:58.005332 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-5639a4b2-c1c1-47d6-8b14-5e4e432069b1 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] 10.222.0.32 "GET /compute/v2.1/servers/3d315266-d4ca-49dd-a23a-422ff48316a9" status: 200 len: 1313 microversion: 2.1 time: 0.250063 May 30 12:05:58.006320 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 132/270] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:57 2022] GET /compute/v2.1/servers/3d315266-d4ca-49dd-a23a-422ff48316a9 => generated 1313 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:05:58.051678 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-4c82300a-4761-46ba-bc53-ad210f04cf8b tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:58.054064 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-4c82300a-4761-46ba-bc53-ad210f04cf8b tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: dcdae5e3-81e8-412d-9e2a-0a481c13b57b] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:58.064049 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-88f23d70-8254-4545-96f9-749734c5b0ac tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:58.064592 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-88f23d70-8254-4545-96f9-749734c5b0ac tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:58.073830 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-88f23d70-8254-4545-96f9-749734c5b0ac tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:58.076784 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-88f23d70-8254-4545-96f9-749734c5b0ac tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:58.077885 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-88f23d70-8254-4545-96f9-749734c5b0ac tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:58.079357 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4c82300a-4761-46ba-bc53-ad210f04cf8b tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:58.079813 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4c82300a-4761-46ba-bc53-ad210f04cf8b tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:58.080636 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4c82300a-4761-46ba-bc53-ad210f04cf8b tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:58.081073 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4c82300a-4761-46ba-bc53-ad210f04cf8b tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:58.084374 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-88f23d70-8254-4545-96f9-749734c5b0ac tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:58.136555 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-88f23d70-8254-4545-96f9-749734c5b0ac tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c/ips" status: 200 len: 150 microversion: 2.20 time: 0.076816 May 30 12:05:58.141488 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 133/271] 10.222.0.32 () {60 vars in 1288 bytes} [Mon May 30 12:05:58 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c/ips => generated 150 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 30 12:05:58.272098 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-4c82300a-4761-46ba-bc53-ad210f04cf8b tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:58.282582 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-4c82300a-4761-46ba-bc53-ad210f04cf8b tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b" status: 200 len: 1522 microversion: 2.1 time: 0.235871 May 30 12:05:58.284263 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 139/272] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:58 2022] GET /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:05:59.023548 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-b02bc352-9249-44d8-a608-155ceed79447 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:59.023979 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-b02bc352-9249-44d8-a608-155ceed79447 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] [instance: 3d315266-d4ca-49dd-a23a-422ff48316a9] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:59.030571 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b02bc352-9249-44d8-a608-155ceed79447 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:59.031021 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b02bc352-9249-44d8-a608-155ceed79447 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:59.032431 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b02bc352-9249-44d8-a608-155ceed79447 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:59.032876 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b02bc352-9249-44d8-a608-155ceed79447 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:59.170441 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-b02bc352-9249-44d8-a608-155ceed79447 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a440b40bc3124bafa502f66a004d0de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7843d3fb7cb402b8a85179da7bfffaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:59.178518 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-b02bc352-9249-44d8-a608-155ceed79447 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] 10.222.0.32 "GET /compute/v2.1/servers/3d315266-d4ca-49dd-a23a-422ff48316a9" status: 200 len: 1313 microversion: 2.1 time: 0.158970 May 30 12:05:59.179119 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 134/273] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:59 2022] GET /compute/v2.1/servers/3d315266-d4ca-49dd-a23a-422ff48316a9 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:05:59.300620 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-797e7f3d-dd06-4901-bd4e-9d0d960fefdb tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:05:59.301233 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-797e7f3d-dd06-4901-bd4e-9d0d960fefdb tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: dcdae5e3-81e8-412d-9e2a-0a481c13b57b] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:05:59.307182 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-797e7f3d-dd06-4901-bd4e-9d0d960fefdb tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:59.307630 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-797e7f3d-dd06-4901-bd4e-9d0d960fefdb tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:59.308448 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-797e7f3d-dd06-4901-bd4e-9d0d960fefdb tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:59.308887 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-797e7f3d-dd06-4901-bd4e-9d0d960fefdb tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:59.463691 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-797e7f3d-dd06-4901-bd4e-9d0d960fefdb tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:05:59.471920 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-797e7f3d-dd06-4901-bd4e-9d0d960fefdb tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b" status: 200 len: 1522 microversion: 2.1 time: 0.175100 May 30 12:05:59.472975 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 140/274] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:05:59 2022] GET /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:06:00.199215 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-c492f8f6-2fac-4580-b9e4-68b32a60e1fa tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:00.199992 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-c492f8f6-2fac-4580-b9e4-68b32a60e1fa tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] [instance: 3d315266-d4ca-49dd-a23a-422ff48316a9] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:00.207117 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c492f8f6-2fac-4580-b9e4-68b32a60e1fa tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:00.207605 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c492f8f6-2fac-4580-b9e4-68b32a60e1fa tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:00.208406 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c492f8f6-2fac-4580-b9e4-68b32a60e1fa tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:00.208853 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c492f8f6-2fac-4580-b9e4-68b32a60e1fa tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:00.351539 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-c492f8f6-2fac-4580-b9e4-68b32a60e1fa tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a440b40bc3124bafa502f66a004d0de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7843d3fb7cb402b8a85179da7bfffaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:00.359892 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-c492f8f6-2fac-4580-b9e4-68b32a60e1fa tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] 10.222.0.32 "GET /compute/v2.1/servers/3d315266-d4ca-49dd-a23a-422ff48316a9" status: 200 len: 1313 microversion: 2.1 time: 0.165877 May 30 12:06:00.360888 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 135/275] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:00 2022] GET /compute/v2.1/servers/3d315266-d4ca-49dd-a23a-422ff48316a9 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:06:00.489485 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-5d811729-a94b-43d6-9d3c-8b1095c83d50 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:00.490099 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-5d811729-a94b-43d6-9d3c-8b1095c83d50 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: dcdae5e3-81e8-412d-9e2a-0a481c13b57b] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:00.496875 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5d811729-a94b-43d6-9d3c-8b1095c83d50 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:00.500772 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5d811729-a94b-43d6-9d3c-8b1095c83d50 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:00.502307 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5d811729-a94b-43d6-9d3c-8b1095c83d50 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:00.502919 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5d811729-a94b-43d6-9d3c-8b1095c83d50 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:00.663762 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-5d811729-a94b-43d6-9d3c-8b1095c83d50 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:00.671748 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-5d811729-a94b-43d6-9d3c-8b1095c83d50 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b" status: 200 len: 1522 microversion: 2.1 time: 0.186044 May 30 12:06:00.672601 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 141/276] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:00 2022] GET /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:06:01.376872 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-ade4716b-f84c-4c0f-a4ec-651ce1624af4 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:01.377388 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-ade4716b-f84c-4c0f-a4ec-651ce1624af4 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] [instance: 3d315266-d4ca-49dd-a23a-422ff48316a9] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:01.384042 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ade4716b-f84c-4c0f-a4ec-651ce1624af4 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:01.384533 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ade4716b-f84c-4c0f-a4ec-651ce1624af4 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:01.385298 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ade4716b-f84c-4c0f-a4ec-651ce1624af4 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:01.385738 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ade4716b-f84c-4c0f-a4ec-651ce1624af4 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:01.513293 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-ade4716b-f84c-4c0f-a4ec-651ce1624af4 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a440b40bc3124bafa502f66a004d0de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7843d3fb7cb402b8a85179da7bfffaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:01.521135 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-ade4716b-f84c-4c0f-a4ec-651ce1624af4 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] 10.222.0.32 "GET /compute/v2.1/servers/3d315266-d4ca-49dd-a23a-422ff48316a9" status: 200 len: 1313 microversion: 2.1 time: 0.148207 May 30 12:06:01.521695 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 136/277] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:01 2022] GET /compute/v2.1/servers/3d315266-d4ca-49dd-a23a-422ff48316a9 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:06:01.540045 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-00866de8-9f2e-4a16-bf10-243bb6f1f791 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:01.540545 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-00866de8-9f2e-4a16-bf10-243bb6f1f791 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 08b1b860-516e-4041-8df8-1fa8cc65a4ed] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:01.546635 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-00866de8-9f2e-4a16-bf10-243bb6f1f791 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:01.547989 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-00866de8-9f2e-4a16-bf10-243bb6f1f791 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:01.548774 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-00866de8-9f2e-4a16-bf10-243bb6f1f791 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:01.549325 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-00866de8-9f2e-4a16-bf10-243bb6f1f791 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:01.572903 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-00866de8-9f2e-4a16-bf10-243bb6f1f791 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed/ips" status: 200 len: 146 microversion: 2.1 time: 0.036638 May 30 12:06:01.578516 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 142/278] 10.222.0.32 () {58 vars in 1247 bytes} [Mon May 30 12:06:01 2022] GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed/ips => generated 146 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:06:01.688984 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-54b6eaf0-5679-425a-a7e7-90a4a508bf51 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:01.689599 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-54b6eaf0-5679-425a-a7e7-90a4a508bf51 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: dcdae5e3-81e8-412d-9e2a-0a481c13b57b] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:01.696209 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-54b6eaf0-5679-425a-a7e7-90a4a508bf51 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:01.696660 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-54b6eaf0-5679-425a-a7e7-90a4a508bf51 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:01.697422 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-54b6eaf0-5679-425a-a7e7-90a4a508bf51 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:01.697857 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-54b6eaf0-5679-425a-a7e7-90a4a508bf51 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:01.824881 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-54b6eaf0-5679-425a-a7e7-90a4a508bf51 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:01.832849 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-54b6eaf0-5679-425a-a7e7-90a4a508bf51 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b" status: 200 len: 1522 microversion: 2.1 time: 0.147750 May 30 12:06:01.833419 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 137/279] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:01 2022] GET /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:06:02.538016 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-1a9bc77b-dbc7-4dd8-a6a7-2ec928a90b90 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:02.538624 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-1a9bc77b-dbc7-4dd8-a6a7-2ec928a90b90 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] [instance: 3d315266-d4ca-49dd-a23a-422ff48316a9] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:02.544620 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1a9bc77b-dbc7-4dd8-a6a7-2ec928a90b90 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:02.545205 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1a9bc77b-dbc7-4dd8-a6a7-2ec928a90b90 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:02.545809 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1a9bc77b-dbc7-4dd8-a6a7-2ec928a90b90 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:02.546238 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1a9bc77b-dbc7-4dd8-a6a7-2ec928a90b90 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:02.688493 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-1a9bc77b-dbc7-4dd8-a6a7-2ec928a90b90 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a440b40bc3124bafa502f66a004d0de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7843d3fb7cb402b8a85179da7bfffaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:02.696596 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-1a9bc77b-dbc7-4dd8-a6a7-2ec928a90b90 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] 10.222.0.32 "GET /compute/v2.1/servers/3d315266-d4ca-49dd-a23a-422ff48316a9" status: 200 len: 1313 microversion: 2.1 time: 0.162303 May 30 12:06:02.701245 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 143/280] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:02 2022] GET /compute/v2.1/servers/3d315266-d4ca-49dd-a23a-422ff48316a9 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:06:02.850286 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-d5edc4ab-d2b1-4a1a-b311-cb37ddc5b3fb tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:02.851056 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-d5edc4ab-d2b1-4a1a-b311-cb37ddc5b3fb tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: dcdae5e3-81e8-412d-9e2a-0a481c13b57b] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:02.858306 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d5edc4ab-d2b1-4a1a-b311-cb37ddc5b3fb tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:02.858805 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d5edc4ab-d2b1-4a1a-b311-cb37ddc5b3fb tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:02.860198 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d5edc4ab-d2b1-4a1a-b311-cb37ddc5b3fb tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:02.860896 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d5edc4ab-d2b1-4a1a-b311-cb37ddc5b3fb tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:03.009762 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-d5edc4ab-d2b1-4a1a-b311-cb37ddc5b3fb tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:03.018256 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-d5edc4ab-d2b1-4a1a-b311-cb37ddc5b3fb tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b" status: 200 len: 1522 microversion: 2.1 time: 0.172076 May 30 12:06:03.018824 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 138/281] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:02 2022] GET /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:06:03.715005 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-b51b50c5-c2ba-49dd-8355-2bd4b3895986 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:03.715904 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-b51b50c5-c2ba-49dd-8355-2bd4b3895986 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] [instance: 3d315266-d4ca-49dd-a23a-422ff48316a9] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:03.723025 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b51b50c5-c2ba-49dd-8355-2bd4b3895986 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:03.724317 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b51b50c5-c2ba-49dd-8355-2bd4b3895986 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:03.725101 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b51b50c5-c2ba-49dd-8355-2bd4b3895986 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:03.725536 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b51b50c5-c2ba-49dd-8355-2bd4b3895986 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:03.867488 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-32ad2ffe-cfa6-4271-8004-71e2e72a2d0d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:06:03.868060 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-32ad2ffe-cfa6-4271-8004-71e2e72a2d0d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:03.876350 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-b51b50c5-c2ba-49dd-8355-2bd4b3895986 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a440b40bc3124bafa502f66a004d0de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7843d3fb7cb402b8a85179da7bfffaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:03.877050 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-32ad2ffe-cfa6-4271-8004-71e2e72a2d0d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:03.877507 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-32ad2ffe-cfa6-4271-8004-71e2e72a2d0d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:03.878304 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-32ad2ffe-cfa6-4271-8004-71e2e72a2d0d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:03.878915 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-32ad2ffe-cfa6-4271-8004-71e2e72a2d0d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:03.891343 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-b51b50c5-c2ba-49dd-8355-2bd4b3895986 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] 10.222.0.32 "GET /compute/v2.1/servers/3d315266-d4ca-49dd-a23a-422ff48316a9" status: 200 len: 1497 microversion: 2.1 time: 0.180712 May 30 12:06:03.892583 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 144/282] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:03 2022] GET /compute/v2.1/servers/3d315266-d4ca-49dd-a23a-422ff48316a9 => generated 1497 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:06:03.911501 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.objects.instance [None req-32ad2ffe-cfa6-4271-8004-71e2e72a2d0d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lazy-loading 'flavor' on Instance uuid 314658c0-2ad4-4987-99bc-f8acf2d7e46c {{(pid=117670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 30 12:06:04.036727 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-07f6e926-54e2-44e1-8db1-9608bb1283a8 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:04.037240 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-07f6e926-54e2-44e1-8db1-9608bb1283a8 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: dcdae5e3-81e8-412d-9e2a-0a481c13b57b] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:04.044068 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-07f6e926-54e2-44e1-8db1-9608bb1283a8 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:04.044910 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-07f6e926-54e2-44e1-8db1-9608bb1283a8 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:04.045995 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-07f6e926-54e2-44e1-8db1-9608bb1283a8 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:04.046490 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-07f6e926-54e2-44e1-8db1-9608bb1283a8 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:04.215537 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-07f6e926-54e2-44e1-8db1-9608bb1283a8 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:04.227475 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-07f6e926-54e2-44e1-8db1-9608bb1283a8 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b" status: 200 len: 1522 microversion: 2.1 time: 0.194410 May 30 12:06:04.228072 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 145/283] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:04 2022] GET /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:06:04.272366 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-32ad2ffe-cfa6-4271-8004-71e2e72a2d0d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "POST /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c/action" status: 202 len: 0 microversion: 2.20 time: 0.405643 May 30 12:06:04.283960 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 139/284] 10.222.0.32 () {62 vars in 1318 bytes} [Mon May 30 12:06:03 2022] POST /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c/action => generated 0 bytes in 421 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 30 12:06:04.292853 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-b793c5b2-1da4-4c8a-bf8d-e7e419dc9723 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:04.293836 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-b793c5b2-1da4-4c8a-bf8d-e7e419dc9723 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:04.301883 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b793c5b2-1da4-4c8a-bf8d-e7e419dc9723 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:04.302611 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b793c5b2-1da4-4c8a-bf8d-e7e419dc9723 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:04.304115 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b793c5b2-1da4-4c8a-bf8d-e7e419dc9723 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:04.305013 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b793c5b2-1da4-4c8a-bf8d-e7e419dc9723 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:04.476014 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-b793c5b2-1da4-4c8a-bf8d-e7e419dc9723 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:04.487173 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-b793c5b2-1da4-4c8a-bf8d-e7e419dc9723 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:04.490572 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-b793c5b2-1da4-4c8a-bf8d-e7e419dc9723 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:04.493292 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-b793c5b2-1da4-4c8a-bf8d-e7e419dc9723 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1723 microversion: 2.20 time: 0.204399 May 30 12:06:04.494339 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 146/285] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:06:04 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1723 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:06:05.100979 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-ff981490-8f2c-438f-8305-b97e988f6d1d tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:05.101638 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-ff981490-8f2c-438f-8305-b97e988f6d1d tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] [instance: 3d315266-d4ca-49dd-a23a-422ff48316a9] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:05.108203 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ff981490-8f2c-438f-8305-b97e988f6d1d tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:05.108655 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ff981490-8f2c-438f-8305-b97e988f6d1d tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:05.110011 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ff981490-8f2c-438f-8305-b97e988f6d1d tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:05.110454 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ff981490-8f2c-438f-8305-b97e988f6d1d tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:05.135434 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-ff981490-8f2c-438f-8305-b97e988f6d1d tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] [instance: 3d315266-d4ca-49dd-a23a-422ff48316a9] Going to try to terminate instance {{(pid=117670) delete /opt/stack/nova/nova/compute/api.py:2664}} May 30 12:06:05.189685 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:05.227413 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-ff981490-8f2c-438f-8305-b97e988f6d1d tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] 10.222.0.32 "DELETE /compute/v2.1/servers/3d315266-d4ca-49dd-a23a-422ff48316a9" status: 204 len: 0 microversion: 2.1 time: 0.131044 May 30 12:06:05.228624 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 140/286] 10.222.0.32 () {58 vars in 1238 bytes} [Mon May 30 12:06:05 2022] DELETE /compute/v2.1/servers/3d315266-d4ca-49dd-a23a-422ff48316a9 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 30 12:06:05.237974 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-2db7e132-1bfe-4b4b-9575-6fc9977953d7 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:05.238691 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-2db7e132-1bfe-4b4b-9575-6fc9977953d7 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] [instance: 3d315266-d4ca-49dd-a23a-422ff48316a9] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:05.245601 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2db7e132-1bfe-4b4b-9575-6fc9977953d7 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:05.246048 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2db7e132-1bfe-4b4b-9575-6fc9977953d7 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:05.246217 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-e01e844c-5af8-4016-bdb7-41ac26a36631 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:05.246788 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-e01e844c-5af8-4016-bdb7-41ac26a36631 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: dcdae5e3-81e8-412d-9e2a-0a481c13b57b] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:05.246949 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2db7e132-1bfe-4b4b-9575-6fc9977953d7 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:05.247274 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2db7e132-1bfe-4b4b-9575-6fc9977953d7 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:05.253533 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e01e844c-5af8-4016-bdb7-41ac26a36631 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:05.254017 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e01e844c-5af8-4016-bdb7-41ac26a36631 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:05.254884 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e01e844c-5af8-4016-bdb7-41ac26a36631 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:05.255343 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e01e844c-5af8-4016-bdb7-41ac26a36631 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:05.454574 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-2db7e132-1bfe-4b4b-9575-6fc9977953d7 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a440b40bc3124bafa502f66a004d0de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7843d3fb7cb402b8a85179da7bfffaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:05.458019 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-e01e844c-5af8-4016-bdb7-41ac26a36631 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:05.467495 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-e01e844c-5af8-4016-bdb7-41ac26a36631 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b" status: 200 len: 1522 microversion: 2.1 time: 0.224334 May 30 12:06:05.467495 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 141/287] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:05 2022] GET /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:06:05.473790 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-2db7e132-1bfe-4b4b-9575-6fc9977953d7 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] 10.222.0.32 "GET /compute/v2.1/servers/3d315266-d4ca-49dd-a23a-422ff48316a9" status: 200 len: 1503 microversion: 2.1 time: 0.240589 May 30 12:06:05.474362 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 147/288] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:05 2022] GET /compute/v2.1/servers/3d315266-d4ca-49dd-a23a-422ff48316a9 => generated 1503 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:06:05.513724 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-7311e781-8208-4a86-b839-43732cf30537 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:05.514441 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-7311e781-8208-4a86-b839-43732cf30537 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:05.522056 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7311e781-8208-4a86-b839-43732cf30537 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:05.522592 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7311e781-8208-4a86-b839-43732cf30537 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:05.523410 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7311e781-8208-4a86-b839-43732cf30537 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:05.523825 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7311e781-8208-4a86-b839-43732cf30537 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:05.635093 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-c26fca0a-1843-46d4-9551-e41af62a0fbc tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6b957e5c-871c-4a09-aa09-04b2b9efb383"}} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:06:05.636219 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-c26fca0a-1843-46d4-9551-e41af62a0fbc tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 08b1b860-516e-4041-8df8-1fa8cc65a4ed] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:05.643150 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c26fca0a-1843-46d4-9551-e41af62a0fbc tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:05.643596 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c26fca0a-1843-46d4-9551-e41af62a0fbc tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:05.644393 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c26fca0a-1843-46d4-9551-e41af62a0fbc tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:05.645073 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c26fca0a-1843-46d4-9551-e41af62a0fbc tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:05.668654 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-7311e781-8208-4a86-b839-43732cf30537 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:05.677629 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-7311e781-8208-4a86-b839-43732cf30537 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:05.679145 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-7311e781-8208-4a86-b839-43732cf30537 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:05.680342 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-7311e781-8208-4a86-b839-43732cf30537 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1723 microversion: 2.20 time: 0.170522 May 30 12:06:05.680898 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 142/289] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:06:05 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:06:06.483337 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-86e6951e-ca95-4224-be51-1547d6512d01 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:06.484001 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-86e6951e-ca95-4224-be51-1547d6512d01 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: dcdae5e3-81e8-412d-9e2a-0a481c13b57b] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:06.490886 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-86e6951e-ca95-4224-be51-1547d6512d01 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:06.491333 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-86e6951e-ca95-4224-be51-1547d6512d01 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:06.492100 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-86e6951e-ca95-4224-be51-1547d6512d01 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:06.492559 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-86e6951e-ca95-4224-be51-1547d6512d01 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:06.621777 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-86e6951e-ca95-4224-be51-1547d6512d01 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:06.630276 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-86e6951e-ca95-4224-be51-1547d6512d01 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b" status: 200 len: 1522 microversion: 2.1 time: 0.150578 May 30 12:06:06.630846 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 143/290] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:06 2022] GET /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:06:06.635333 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-10a84736-76da-4799-8c5e-bd3f12b61f5f tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:06.635947 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-10a84736-76da-4799-8c5e-bd3f12b61f5f tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] [instance: 3d315266-d4ca-49dd-a23a-422ff48316a9] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:06.645086 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-10a84736-76da-4799-8c5e-bd3f12b61f5f tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:06.645891 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-10a84736-76da-4799-8c5e-bd3f12b61f5f tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:06.647305 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-10a84736-76da-4799-8c5e-bd3f12b61f5f tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:06.648102 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-10a84736-76da-4799-8c5e-bd3f12b61f5f tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:06.792381 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-10a84736-76da-4799-8c5e-bd3f12b61f5f tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a440b40bc3124bafa502f66a004d0de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7843d3fb7cb402b8a85179da7bfffaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:06.800493 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-10a84736-76da-4799-8c5e-bd3f12b61f5f tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] 10.222.0.32 "GET /compute/v2.1/servers/3d315266-d4ca-49dd-a23a-422ff48316a9" status: 200 len: 1503 microversion: 2.1 time: 0.168662 May 30 12:06:06.801064 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 144/291] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:06 2022] GET /compute/v2.1/servers/3d315266-d4ca-49dd-a23a-422ff48316a9 => generated 1503 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:06:06.805472 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-deb21e75-388a-47eb-9b81-6870cfb64ba0 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:06.806111 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-deb21e75-388a-47eb-9b81-6870cfb64ba0 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:06.813415 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-deb21e75-388a-47eb-9b81-6870cfb64ba0 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:06.813937 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-deb21e75-388a-47eb-9b81-6870cfb64ba0 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:06.814705 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-deb21e75-388a-47eb-9b81-6870cfb64ba0 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:06.815150 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-deb21e75-388a-47eb-9b81-6870cfb64ba0 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:06.957754 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-deb21e75-388a-47eb-9b81-6870cfb64ba0 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:06.968334 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-deb21e75-388a-47eb-9b81-6870cfb64ba0 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:06.971074 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-deb21e75-388a-47eb-9b81-6870cfb64ba0 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:06.972306 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-deb21e75-388a-47eb-9b81-6870cfb64ba0 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1723 microversion: 2.20 time: 0.170285 May 30 12:06:06.973044 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 145/292] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:06:06 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:06:07.086387 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-c26fca0a-1843-46d4-9551-e41af62a0fbc tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "POST /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.455013 May 30 12:06:07.087125 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 148/293] 10.222.0.32 () {60 vars in 1322 bytes} [Mon May 30 12:06:05 2022] POST /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed/os-volume_attachments => generated 194 bytes in 1457 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 30 12:06:07.648359 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-7077f6bc-3e46-4d33-b7ff-ffc5ab07934a tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:07.649712 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-7077f6bc-3e46-4d33-b7ff-ffc5ab07934a tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: dcdae5e3-81e8-412d-9e2a-0a481c13b57b] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:07.657123 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7077f6bc-3e46-4d33-b7ff-ffc5ab07934a tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:07.657569 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7077f6bc-3e46-4d33-b7ff-ffc5ab07934a tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:07.658354 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7077f6bc-3e46-4d33-b7ff-ffc5ab07934a tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:07.658792 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7077f6bc-3e46-4d33-b7ff-ffc5ab07934a tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:07.789306 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-5b51f0f6-c4e7-45c4-b7a8-4c0980f28364 req-5b8f37e1-9898-4563-8e05-2ad250a5e3e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d315266-d4ca-49dd-a23a-422ff48316a9", "name": "network-vif-deleted", "tag": "2ca8fe76-2bd8-47a7-b548-22fe3095f649"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:06:07.804787 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-5b51f0f6-c4e7-45c4-b7a8-4c0980f28364 req-5b8f37e1-9898-4563-8e05-2ad250a5e3e8 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:07.805233 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-5b51f0f6-c4e7-45c4-b7a8-4c0980f28364 req-5b8f37e1-9898-4563-8e05-2ad250a5e3e8 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:07.820783 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-5b51f0f6-c4e7-45c4-b7a8-4c0980f28364 req-5b8f37e1-9898-4563-8e05-2ad250a5e3e8 service nova] Creating event network-vif-deleted:2ca8fe76-2bd8-47a7-b548-22fe3095f649 for instance 3d315266-d4ca-49dd-a23a-422ff48316a9 on hv-cinder-84051 May 30 12:06:07.827632 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-5b51f0f6-c4e7-45c4-b7a8-4c0980f28364 req-5b8f37e1-9898-4563-8e05-2ad250a5e3e8 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044614 May 30 12:06:07.828784 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 149/294] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:06:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:06:07.834916 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-233d7cf7-fedf-474f-9751-eb694cd33a02 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:07.835629 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-233d7cf7-fedf-474f-9751-eb694cd33a02 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] [instance: 3d315266-d4ca-49dd-a23a-422ff48316a9] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:07.836928 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-7077f6bc-3e46-4d33-b7ff-ffc5ab07934a tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:07.845680 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-233d7cf7-fedf-474f-9751-eb694cd33a02 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:07.846284 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-233d7cf7-fedf-474f-9751-eb694cd33a02 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:07.847501 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-233d7cf7-fedf-474f-9751-eb694cd33a02 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:07.848245 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-233d7cf7-fedf-474f-9751-eb694cd33a02 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:07.849084 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-7077f6bc-3e46-4d33-b7ff-ffc5ab07934a tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b" status: 200 len: 1522 microversion: 2.1 time: 0.205186 May 30 12:06:07.860352 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 146/295] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:07 2022] GET /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:06:07.918187 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-233d7cf7-fedf-474f-9751-eb694cd33a02 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a440b40bc3124bafa502f66a004d0de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7843d3fb7cb402b8a85179da7bfffaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:07.926963 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-233d7cf7-fedf-474f-9751-eb694cd33a02 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] 10.222.0.32 "GET /compute/v2.1/servers/3d315266-d4ca-49dd-a23a-422ff48316a9" status: 200 len: 1298 microversion: 2.1 time: 0.096509 May 30 12:06:07.927644 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 150/296] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:07 2022] GET /compute/v2.1/servers/3d315266-d4ca-49dd-a23a-422ff48316a9 => generated 1298 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:06:07.990598 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-af1701f0-bf2b-4d56-8fa6-c13987412410 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:07.991210 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-af1701f0-bf2b-4d56-8fa6-c13987412410 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:07.997375 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-af1701f0-bf2b-4d56-8fa6-c13987412410 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:07.997802 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-af1701f0-bf2b-4d56-8fa6-c13987412410 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:07.998569 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-af1701f0-bf2b-4d56-8fa6-c13987412410 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:07.999001 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-af1701f0-bf2b-4d56-8fa6-c13987412410 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:08.132993 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-af1701f0-bf2b-4d56-8fa6-c13987412410 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:08.141926 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-af1701f0-bf2b-4d56-8fa6-c13987412410 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:08.143486 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-af1701f0-bf2b-4d56-8fa6-c13987412410 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:08.145065 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-af1701f0-bf2b-4d56-8fa6-c13987412410 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1723 microversion: 2.20 time: 0.158440 May 30 12:06:08.145615 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 147/297] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:06:07 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:06:08.866872 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-54480b26-14b3-4085-874b-7719afa5700b tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:08.867384 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-54480b26-14b3-4085-874b-7719afa5700b tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: dcdae5e3-81e8-412d-9e2a-0a481c13b57b] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:08.873905 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-54480b26-14b3-4085-874b-7719afa5700b tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:08.874359 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-54480b26-14b3-4085-874b-7719afa5700b tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:08.875642 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-54480b26-14b3-4085-874b-7719afa5700b tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:08.876087 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-54480b26-14b3-4085-874b-7719afa5700b tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:08.943918 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-e43b95dc-a0a6-4d0a-ba41-ce677c602763 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:08.944592 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-e43b95dc-a0a6-4d0a-ba41-ce677c602763 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] [instance: 3d315266-d4ca-49dd-a23a-422ff48316a9] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:08.951062 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e43b95dc-a0a6-4d0a-ba41-ce677c602763 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:08.951501 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e43b95dc-a0a6-4d0a-ba41-ce677c602763 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:08.952306 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e43b95dc-a0a6-4d0a-ba41-ce677c602763 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:08.952745 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e43b95dc-a0a6-4d0a-ba41-ce677c602763 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:08.987665 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e43b95dc-a0a6-4d0a-ba41-ce677c602763 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:08.988230 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e43b95dc-a0a6-4d0a-ba41-ce677c602763 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:08.988696 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.objects.instance [None req-e43b95dc-a0a6-4d0a-ba41-ce677c602763 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lazy-loading 'fault' on Instance uuid 3d315266-d4ca-49dd-a23a-422ff48316a9 {{(pid=117670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 30 12:06:09.027352 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-54480b26-14b3-4085-874b-7719afa5700b tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:09.035085 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-54480b26-14b3-4085-874b-7719afa5700b tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b" status: 200 len: 1522 microversion: 2.1 time: 0.172111 May 30 12:06:09.035651 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 151/298] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:08 2022] GET /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:06:09.043809 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-e43b95dc-a0a6-4d0a-ba41-ce677c602763 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a440b40bc3124bafa502f66a004d0de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7843d3fb7cb402b8a85179da7bfffaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:09.051793 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-e43b95dc-a0a6-4d0a-ba41-ce677c602763 tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] 10.222.0.32 "GET /compute/v2.1/servers/3d315266-d4ca-49dd-a23a-422ff48316a9" status: 200 len: 1303 microversion: 2.1 time: 0.111811 May 30 12:06:09.052398 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 148/299] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:08 2022] GET /compute/v2.1/servers/3d315266-d4ca-49dd-a23a-422ff48316a9 => generated 1303 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:06:09.165394 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-ed05bc14-e1a1-4a2d-9d22-5390bddd8a14 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:09.165918 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-ed05bc14-e1a1-4a2d-9d22-5390bddd8a14 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:09.172013 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ed05bc14-e1a1-4a2d-9d22-5390bddd8a14 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:09.172616 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ed05bc14-e1a1-4a2d-9d22-5390bddd8a14 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:09.173403 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ed05bc14-e1a1-4a2d-9d22-5390bddd8a14 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:09.173835 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ed05bc14-e1a1-4a2d-9d22-5390bddd8a14 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:09.311160 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-ed05bc14-e1a1-4a2d-9d22-5390bddd8a14 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:09.320854 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-ed05bc14-e1a1-4a2d-9d22-5390bddd8a14 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:09.322352 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-ed05bc14-e1a1-4a2d-9d22-5390bddd8a14 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:09.323799 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-ed05bc14-e1a1-4a2d-9d22-5390bddd8a14 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1723 microversion: 2.20 time: 0.162529 May 30 12:06:09.324442 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 152/300] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:06:09 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:06:10.089679 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-a2db994b-8fa9-4d71-9ee1-e53e6609e5aa tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:10.093530 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-2b407804-edc8-424c-9f2e-7349dcad7291 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:10.100352 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-a2db994b-8fa9-4d71-9ee1-e53e6609e5aa tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] [instance: 3d315266-d4ca-49dd-a23a-422ff48316a9] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:10.105000 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-2b407804-edc8-424c-9f2e-7349dcad7291 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: dcdae5e3-81e8-412d-9e2a-0a481c13b57b] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:10.120724 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2b407804-edc8-424c-9f2e-7349dcad7291 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:10.121183 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2b407804-edc8-424c-9f2e-7349dcad7291 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:10.122675 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2b407804-edc8-424c-9f2e-7349dcad7291 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:10.123101 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2b407804-edc8-424c-9f2e-7349dcad7291 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:10.127070 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a2db994b-8fa9-4d71-9ee1-e53e6609e5aa tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:10.127526 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a2db994b-8fa9-4d71-9ee1-e53e6609e5aa tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:10.128336 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a2db994b-8fa9-4d71-9ee1-e53e6609e5aa tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:10.128769 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a2db994b-8fa9-4d71-9ee1-e53e6609e5aa tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:10.153404 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.wsgi [None req-a2db994b-8fa9-4d71-9ee1-e53e6609e5aa tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] HTTP exception thrown: Instance 3d315266-d4ca-49dd-a23a-422ff48316a9 could not be found. May 30 12:06:10.155050 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-a2db994b-8fa9-4d71-9ee1-e53e6609e5aa tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Request method failure captured: May 30 12:06:10.155050 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: request: GET /compute/v2.1/servers/3d315266-d4ca-49dd-a23a-422ff48316a9 HTTP/1.1 May 30 12:06:10.155050 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Accept: application/json May 30 12:06:10.155050 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Accept-Encoding: identity May 30 12:06:10.155050 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Connection: close May 30 12:06:10.155050 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Content-Length: 0 May 30 12:06:10.155050 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Content-Type: application/json May 30 12:06:10.155050 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Host: 10.222.0.32 May 30 12:06:10.155050 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Openstack-System-Scope: None May 30 12:06:10.155050 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: User-Agent: python-urllib3/1.26.9 May 30 12:06:10.155050 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Auth-Token: gAAAAABilLMBKaWsMEy-KFPco3Ua5WGHQoMvWvYcTotIy0ScFya8DdKBfTkB0WOQu1HsItYVxz6cX5nY5swUGx4ni0VTMjSWtqm3PSISM6b0-zkMhz8JjfSYN6wNQ15R3dafyF8GGRrWbtg60-E5Ve-ao6KvBgMInQz8bi_qmUDIhBPDQP5W-Qo May 30 12:06:10.155050 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Domain-Id: None May 30 12:06:10.155050 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Domain-Name: None May 30 12:06:10.155050 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Identity-Status: Confirmed May 30 12:06:10.155050 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Is-Admin-Project: True May 30 12:06:10.155050 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Domain-Id: default May 30 12:06:10.155050 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Domain-Name: Default May 30 12:06:10.155050 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Id: b7843d3fb7cb402b8a85179da7bfffaa May 30 12:06:10.155050 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Name: tempest-VolumesActionsTest-578485732 May 30 12:06:10.155050 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Role: reader,member May 30 12:06:10.155050 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Roles: reader,member May 30 12:06:10.157059 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/b7843d3fb7cb402b8a85179da7bfffaa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/b7843d3fb7cb402b8a85179da7bfffaa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/b7843d3fb7cb402b8a85179da7bfffaa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_b7843d3fb7cb402b8a85179da7bfffaa", "adminURL": "http://10.222.0.32:8080"}]}] May 30 12:06:10.157059 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Tenant: tempest-VolumesActionsTest-578485732 May 30 12:06:10.157059 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Tenant-Id: b7843d3fb7cb402b8a85179da7bfffaa May 30 12:06:10.157059 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Tenant-Name: tempest-VolumesActionsTest-578485732 May 30 12:06:10.157059 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User: tempest-VolumesActionsTest-578485732-project May 30 12:06:10.157059 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Domain-Id: default May 30 12:06:10.157059 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Domain-Name: Default May 30 12:06:10.157059 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Id: a440b40bc3124bafa502f66a004d0de0 May 30 12:06:10.157059 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Name: tempest-VolumesActionsTest-578485732-project May 30 12:06:10.157059 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: method: > May 30 12:06:10.157059 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: exception: Instance 3d315266-d4ca-49dd-a23a-422ff48316a9 could not be found. May 30 12:06:10.157059 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: action_args: {'id': '3d315266-d4ca-49dd-a23a-422ff48316a9'} May 30 12:06:10.157838 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:06:10.157838 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:06:10.157838 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:06:10.157838 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:06:10.157838 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:06:10.157838 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:06:10.157838 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:06:10.157838 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:06:10.157838 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:06:10.157838 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:06:10.157838 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d315266-d4ca-49dd-a23a-422ff48316a9 could not be found. May 30 12:06:10.157838 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:06:10.157838 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:06:10.157838 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:06:10.157838 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:06:10.157838 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:06:10.157838 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:06:10.157838 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:06:10.157838 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:06:10.157838 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:06:10.158988 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:06:10.158988 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 30 12:06:10.158988 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 30 12:06:10.158988 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 30 12:06:10.158988 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 30 12:06:10.158988 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:06:10.158988 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:06:10.158988 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d315266-d4ca-49dd-a23a-422ff48316a9 could not be found. May 30 12:06:10.158988 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:06:10.158988 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:06:10.158988 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:06:10.158988 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:06:10.158988 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:06:10.158988 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:06:10.158988 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:06:10.158988 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:06:10.158988 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d315266-d4ca-49dd-a23a-422ff48316a9 could not be found. May 30 12:06:10.158988 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:06:10.161111 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-a2db994b-8fa9-4d71-9ee1-e53e6609e5aa tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] Returning 404 to user: Instance 3d315266-d4ca-49dd-a23a-422ff48316a9 could not be found. {{(pid=117671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:06:10.161975 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-a2db994b-8fa9-4d71-9ee1-e53e6609e5aa tempest-VolumesActionsTest-578485732 tempest-VolumesActionsTest-578485732-project] 10.222.0.32 "GET /compute/v2.1/servers/3d315266-d4ca-49dd-a23a-422ff48316a9" status: 404 len: 111 microversion: 2.1 time: 0.094627 May 30 12:06:10.162530 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 153/301] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:10 2022] GET /compute/v2.1/servers/3d315266-d4ca-49dd-a23a-422ff48316a9 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 30 12:06:10.347069 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-ca5b1050-0293-45da-a361-3c50d4f2df34 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:10.348243 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-ca5b1050-0293-45da-a361-3c50d4f2df34 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:10.374416 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ca5b1050-0293-45da-a361-3c50d4f2df34 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:10.375779 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ca5b1050-0293-45da-a361-3c50d4f2df34 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:10.381455 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ca5b1050-0293-45da-a361-3c50d4f2df34 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:10.382628 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ca5b1050-0293-45da-a361-3c50d4f2df34 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:10.404031 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-2b407804-edc8-424c-9f2e-7349dcad7291 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:10.415549 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-2b407804-edc8-424c-9f2e-7349dcad7291 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b" status: 200 len: 1522 microversion: 2.1 time: 0.366641 May 30 12:06:10.416578 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 149/302] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:10 2022] GET /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b => generated 1522 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:06:10.420887 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:10.605081 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-ca5b1050-0293-45da-a361-3c50d4f2df34 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:10.627115 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-ca5b1050-0293-45da-a361-3c50d4f2df34 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:10.628710 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-ca5b1050-0293-45da-a361-3c50d4f2df34 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:10.629905 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-ca5b1050-0293-45da-a361-3c50d4f2df34 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1723 microversion: 2.20 time: 0.289889 May 30 12:06:10.630445 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 154/303] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:06:10 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1723 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:06:11.433754 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-7e51b2f2-6d6c-447f-bd5b-0497058a4657 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:11.434899 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-7e51b2f2-6d6c-447f-bd5b-0497058a4657 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: dcdae5e3-81e8-412d-9e2a-0a481c13b57b] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:11.442680 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7e51b2f2-6d6c-447f-bd5b-0497058a4657 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:11.443330 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7e51b2f2-6d6c-447f-bd5b-0497058a4657 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:11.444506 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7e51b2f2-6d6c-447f-bd5b-0497058a4657 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:11.444953 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7e51b2f2-6d6c-447f-bd5b-0497058a4657 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:11.538037 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-1aa0f44d-b321-4dc2-8b42-e740118ee53a tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:06:11.548130 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1aa0f44d-b321-4dc2-8b42-e740118ee53a tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:11.548852 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1aa0f44d-b321-4dc2-8b42-e740118ee53a tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:11.634593 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-1aa0f44d-b321-4dc2-8b42-e740118ee53a tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 08b1b860-516e-4041-8df8-1fa8cc65a4ed] Going to try to stop instance {{(pid=117671) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 30 12:06:11.674919 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-7e51b2f2-6d6c-447f-bd5b-0497058a4657 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:11.683460 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-7e51b2f2-6d6c-447f-bd5b-0497058a4657 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b" status: 200 len: 1522 microversion: 2.1 time: 0.253465 May 30 12:06:11.684315 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 150/304] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:11 2022] GET /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b => generated 1522 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:06:11.693125 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-1aa0f44d-b321-4dc2-8b42-e740118ee53a tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "POST /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed/action" status: 202 len: 0 microversion: 2.1 time: 0.155029 May 30 12:06:11.693125 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 155/305] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 30 12:06:11 2022] POST /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed/action => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 30 12:06:11.693125 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-e163d0f5-8b8b-4bd0-849b-fc9c25c7164f tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:11.693125 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-e163d0f5-8b8b-4bd0-849b-fc9c25c7164f tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:11.699199 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-4f28885e-8006-46ec-a263-a78f1c025f1b tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:11.699626 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e163d0f5-8b8b-4bd0-849b-fc9c25c7164f tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:11.700137 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e163d0f5-8b8b-4bd0-849b-fc9c25c7164f tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:11.700462 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-4f28885e-8006-46ec-a263-a78f1c025f1b tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 08b1b860-516e-4041-8df8-1fa8cc65a4ed] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:11.700941 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e163d0f5-8b8b-4bd0-849b-fc9c25c7164f tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:11.701503 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e163d0f5-8b8b-4bd0-849b-fc9c25c7164f tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:11.707945 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4f28885e-8006-46ec-a263-a78f1c025f1b tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:11.708777 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4f28885e-8006-46ec-a263-a78f1c025f1b tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:11.709766 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4f28885e-8006-46ec-a263-a78f1c025f1b tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:11.710356 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4f28885e-8006-46ec-a263-a78f1c025f1b tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:12.002153 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-e163d0f5-8b8b-4bd0-849b-fc9c25c7164f tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:12.011526 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-e163d0f5-8b8b-4bd0-849b-fc9c25c7164f tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:12.013872 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-e163d0f5-8b8b-4bd0-849b-fc9c25c7164f tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:12.015737 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-e163d0f5-8b8b-4bd0-849b-fc9c25c7164f tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1723 microversion: 2.20 time: 0.327823 May 30 12:06:12.021220 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 156/306] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:06:11 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1723 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:06:12.067520 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-4f28885e-8006-46ec-a263-a78f1c025f1b tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76e8d7bfdc04ea79c83ca7fb6b9ade1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5074cf3e6248668995f266845c8969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:12.078015 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-4f28885e-8006-46ec-a263-a78f1c025f1b tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed" status: 200 len: 1723 microversion: 2.1 time: 0.383140 May 30 12:06:12.091885 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 151/307] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:11 2022] GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed => generated 1723 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:06:12.700561 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-75449c5f-a6b3-4a6c-bec6-1c4fd28a2527 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:12.701384 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-75449c5f-a6b3-4a6c-bec6-1c4fd28a2527 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: dcdae5e3-81e8-412d-9e2a-0a481c13b57b] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:12.709457 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-75449c5f-a6b3-4a6c-bec6-1c4fd28a2527 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:12.709915 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-75449c5f-a6b3-4a6c-bec6-1c4fd28a2527 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:12.710718 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-75449c5f-a6b3-4a6c-bec6-1c4fd28a2527 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:12.711130 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-75449c5f-a6b3-4a6c-bec6-1c4fd28a2527 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:12.880039 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-75449c5f-a6b3-4a6c-bec6-1c4fd28a2527 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:12.887972 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-75449c5f-a6b3-4a6c-bec6-1c4fd28a2527 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b" status: 200 len: 1502 microversion: 2.1 time: 0.191115 May 30 12:06:12.888597 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 157/308] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:12 2022] GET /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b => generated 1502 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:06:12.906400 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-df58d334-6e61-4c3a-b8d2-fc5bd99128ef tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f6a57a14-dd4e-41ea-83c9-e8dacc40d4a9"}} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:06:12.907980 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-df58d334-6e61-4c3a-b8d2-fc5bd99128ef tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: dcdae5e3-81e8-412d-9e2a-0a481c13b57b] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:12.915004 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-df58d334-6e61-4c3a-b8d2-fc5bd99128ef tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:12.915452 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-df58d334-6e61-4c3a-b8d2-fc5bd99128ef tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:12.916250 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-df58d334-6e61-4c3a-b8d2-fc5bd99128ef tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:12.916680 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-df58d334-6e61-4c3a-b8d2-fc5bd99128ef tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:12.941336 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.wsgi [None req-df58d334-6e61-4c3a-b8d2-fc5bd99128ef tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] HTTP exception thrown: Cannot 'attach_volume' instance dcdae5e3-81e8-412d-9e2a-0a481c13b57b while it is in vm_state rescued May 30 12:06:12.943277 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-df58d334-6e61-4c3a-b8d2-fc5bd99128ef tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Request method failure captured: May 30 12:06:12.943277 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: request: POST /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b/os-volume_attachments HTTP/1.1 May 30 12:06:12.943277 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Accept: application/json May 30 12:06:12.943277 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Accept-Encoding: identity May 30 12:06:12.943277 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Connection: close May 30 12:06:12.943277 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Content-Length: 74 May 30 12:06:12.943277 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Content-Type: application/json May 30 12:06:12.943277 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Host: 10.222.0.32 May 30 12:06:12.943277 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Openstack-System-Scope: None May 30 12:06:12.943277 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: User-Agent: python-urllib3/1.26.9 May 30 12:06:12.943277 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Auth-Token: gAAAAABilLLKaQ7R80jiEHRLmMrujboD3ODo5PM_i4LfUigoNF_DSRD-7m3i96fJPk4sXF92TJEZUPTnq8UGqrdvMfAQbAX4zb4JhkZC8_4ziYoLVdZLK1Z5QiAolwIvziAlwa96-4sK6MPzDNEdNjihrFq_GGUSlYxiBpvkGIb3KNss7ddJ3EE May 30 12:06:12.943277 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Domain-Id: None May 30 12:06:12.943277 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Domain-Name: None May 30 12:06:12.943277 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Identity-Status: Confirmed May 30 12:06:12.943277 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Is-Admin-Project: True May 30 12:06:12.943277 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Domain-Id: default May 30 12:06:12.943277 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Domain-Name: Default May 30 12:06:12.943277 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Id: c988db8e79bf4c98ac288105177f90f2 May 30 12:06:12.943277 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1940623031 May 30 12:06:12.943277 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Role: reader,member May 30 12:06:12.943277 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Roles: reader,member May 30 12:06:12.945048 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/c988db8e79bf4c98ac288105177f90f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/c988db8e79bf4c98ac288105177f90f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/c988db8e79bf4c98ac288105177f90f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_c988db8e79bf4c98ac288105177f90f2", "adminURL": "http://10.222.0.32:8080"}]}] May 30 12:06:12.945048 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1940623031 May 30 12:06:12.945048 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant-Id: c988db8e79bf4c98ac288105177f90f2 May 30 12:06:12.945048 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1940623031 May 30 12:06:12.945048 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User: tempest-ServerRescueNegativeTestJSON-1940623031-project May 30 12:06:12.945048 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Domain-Id: default May 30 12:06:12.945048 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Domain-Name: Default May 30 12:06:12.945048 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Id: 166b42a5d6c04659afb20c088dfead76 May 30 12:06:12.945048 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1940623031-project May 30 12:06:12.945048 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: May 30 12:06:12.945048 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: {"volumeAttachment": {"volumeId": "f6a57a14-dd4e-41ea-83c9-e8dacc40d4a9"}} May 30 12:06:12.945048 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: method: > May 30 12:06:12.948978 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: exception: Cannot 'attach_volume' instance dcdae5e3-81e8-412d-9e2a-0a481c13b57b while it is in vm_state rescued May 30 12:06:12.948978 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: action_args: {'server_id': 'dcdae5e3-81e8-412d-9e2a-0a481c13b57b', 'body': {'volumeAttachment': {'volumeId': 'f6a57a14-dd4e-41ea-83c9-e8dacc40d4a9'}}} May 30 12:06:12.948978 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:06:12.948978 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:06:12.948978 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 30 12:06:12.948978 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 30 12:06:12.948978 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 30 12:06:12.948978 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 30 12:06:12.948978 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 30 12:06:12.948978 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 30 12:06:12.948978 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance dcdae5e3-81e8-412d-9e2a-0a481c13b57b in vm_state rescued. Cannot attach_volume while the instance is in this state. May 30 12:06:12.948978 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:06:12.948978 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:06:12.948978 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:06:12.948978 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:06:12.948978 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:06:12.948978 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:06:12.948978 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:06:12.948978 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:06:12.950260 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:06:12.950260 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:06:12.950260 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 30 12:06:12.950260 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 30 12:06:12.950260 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 30 12:06:12.950260 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 30 12:06:12.950260 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 30 12:06:12.950260 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 30 12:06:12.950260 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 30 12:06:12.950260 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 30 12:06:12.950260 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 30 12:06:12.950260 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 30 12:06:12.950260 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance dcdae5e3-81e8-412d-9e2a-0a481c13b57b while it is in vm_state rescued May 30 12:06:12.950260 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:06:12.950260 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:06:12.950260 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:06:12.950260 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:06:12.950260 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:06:12.950260 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:06:12.951487 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:06:12.951487 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:06:12.951487 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance dcdae5e3-81e8-412d-9e2a-0a481c13b57b while it is in vm_state rescued May 30 12:06:12.951487 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:06:12.951487 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-df58d334-6e61-4c3a-b8d2-fc5bd99128ef tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Returning 409 to user: Cannot 'attach_volume' instance dcdae5e3-81e8-412d-9e2a-0a481c13b57b while it is in vm_state rescued {{(pid=117670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:06:12.951487 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-df58d334-6e61-4c3a-b8d2-fc5bd99128ef tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "POST /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.043250 May 30 12:06:12.951487 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 152/309] 10.222.0.32 () {60 vars in 1322 bytes} [Mon May 30 12:06:12 2022] POST /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b/os-volume_attachments => generated 152 bytes in 45 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 30 12:06:12.956941 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-b201d1c3-9a02-4cd1-a462-61b0222c2af9 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:06:12.957710 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-b201d1c3-9a02-4cd1-a462-61b0222c2af9 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: dcdae5e3-81e8-412d-9e2a-0a481c13b57b] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:12.964358 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b201d1c3-9a02-4cd1-a462-61b0222c2af9 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:12.964778 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b201d1c3-9a02-4cd1-a462-61b0222c2af9 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:12.965632 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b201d1c3-9a02-4cd1-a462-61b0222c2af9 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:12.965987 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b201d1c3-9a02-4cd1-a462-61b0222c2af9 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:13.036466 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-ffc249d8-e264-437b-9a15-808f94595e43 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:13.036466 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-ffc249d8-e264-437b-9a15-808f94595e43 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:13.046072 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ffc249d8-e264-437b-9a15-808f94595e43 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:13.046856 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ffc249d8-e264-437b-9a15-808f94595e43 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:13.048575 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ffc249d8-e264-437b-9a15-808f94595e43 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:13.049153 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ffc249d8-e264-437b-9a15-808f94595e43 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:13.061501 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-b201d1c3-9a02-4cd1-a462-61b0222c2af9 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "POST /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b/action" status: 202 len: 0 microversion: 2.1 time: 0.109857 May 30 12:06:13.064171 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 158/310] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 30 12:06:12 2022] POST /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 30 12:06:13.074539 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-e3d63c0d-2488-4e98-9719-0f7f2d58ea58 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:13.075549 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-e3d63c0d-2488-4e98-9719-0f7f2d58ea58 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: dcdae5e3-81e8-412d-9e2a-0a481c13b57b] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:13.087829 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e3d63c0d-2488-4e98-9719-0f7f2d58ea58 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:13.089003 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e3d63c0d-2488-4e98-9719-0f7f2d58ea58 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:13.090552 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e3d63c0d-2488-4e98-9719-0f7f2d58ea58 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:13.091439 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e3d63c0d-2488-4e98-9719-0f7f2d58ea58 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:13.304656 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-ffc249d8-e264-437b-9a15-808f94595e43 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:13.314828 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-ffc249d8-e264-437b-9a15-808f94595e43 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:13.316408 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-ffc249d8-e264-437b-9a15-808f94595e43 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:13.318003 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-ffc249d8-e264-437b-9a15-808f94595e43 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1723 microversion: 2.20 time: 0.287621 May 30 12:06:13.318574 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 153/311] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:06:13 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1723 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 30 12:06:13.333055 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-473e3a12-2f70-4944-98ea-48a4d4ea8007 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:13.333810 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-473e3a12-2f70-4944-98ea-48a4d4ea8007 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 08b1b860-516e-4041-8df8-1fa8cc65a4ed] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:13.339973 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-e3d63c0d-2488-4e98-9719-0f7f2d58ea58 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:13.344990 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-473e3a12-2f70-4944-98ea-48a4d4ea8007 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:13.345456 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-473e3a12-2f70-4944-98ea-48a4d4ea8007 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:13.346320 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-473e3a12-2f70-4944-98ea-48a4d4ea8007 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:13.346760 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-473e3a12-2f70-4944-98ea-48a4d4ea8007 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:13.349418 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-e3d63c0d-2488-4e98-9719-0f7f2d58ea58 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b" status: 200 len: 1510 microversion: 2.1 time: 0.280008 May 30 12:06:13.350311 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 159/312] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:13 2022] GET /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b => generated 1510 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:06:13.489902 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-473e3a12-2f70-4944-98ea-48a4d4ea8007 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76e8d7bfdc04ea79c83ca7fb6b9ade1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5074cf3e6248668995f266845c8969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:13.498403 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-473e3a12-2f70-4944-98ea-48a4d4ea8007 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed" status: 200 len: 1723 microversion: 2.1 time: 0.176830 May 30 12:06:13.498973 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 154/313] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:13 2022] GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:06:14.336571 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-d17db9f4-dba2-4fff-a55b-c2448e22ce5b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:14.337177 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-d17db9f4-dba2-4fff-a55b-c2448e22ce5b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:14.344645 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d17db9f4-dba2-4fff-a55b-c2448e22ce5b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:14.345080 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d17db9f4-dba2-4fff-a55b-c2448e22ce5b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:14.345844 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d17db9f4-dba2-4fff-a55b-c2448e22ce5b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:14.346277 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d17db9f4-dba2-4fff-a55b-c2448e22ce5b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:14.368596 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-a09a0b50-f49d-47c3-ae9a-ddbc1e48229c tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:14.369396 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-a09a0b50-f49d-47c3-ae9a-ddbc1e48229c tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: dcdae5e3-81e8-412d-9e2a-0a481c13b57b] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:14.376829 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a09a0b50-f49d-47c3-ae9a-ddbc1e48229c tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:14.377402 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a09a0b50-f49d-47c3-ae9a-ddbc1e48229c tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:14.378274 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a09a0b50-f49d-47c3-ae9a-ddbc1e48229c tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:14.378808 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a09a0b50-f49d-47c3-ae9a-ddbc1e48229c tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:14.569900 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-d17db9f4-dba2-4fff-a55b-c2448e22ce5b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:14.570361 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-a09a0b50-f49d-47c3-ae9a-ddbc1e48229c tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:14.582195 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-d17db9f4-dba2-4fff-a55b-c2448e22ce5b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:14.587067 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-d17db9f4-dba2-4fff-a55b-c2448e22ce5b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:14.587546 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-a09a0b50-f49d-47c3-ae9a-ddbc1e48229c tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b" status: 200 len: 1510 microversion: 2.1 time: 0.223180 May 30 12:06:14.588137 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 155/314] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:14 2022] GET /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b => generated 1510 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:06:14.590139 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-d17db9f4-dba2-4fff-a55b-c2448e22ce5b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1723 microversion: 2.20 time: 0.257581 May 30 12:06:14.591454 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 160/315] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:06:14 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1723 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:06:14.593384 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-2f44bf2d-d618-4598-945e-5174606f9d45 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:14.594749 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-2f44bf2d-d618-4598-945e-5174606f9d45 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: 54ad4de0-2282-4baf-86a4-40d5ba1ba62a] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:14.608746 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-dcf1e9ea-651e-4576-a037-6e9916da8da0 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:14.608746 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-dcf1e9ea-651e-4576-a037-6e9916da8da0 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 08b1b860-516e-4041-8df8-1fa8cc65a4ed] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:14.610046 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-dcf1e9ea-651e-4576-a037-6e9916da8da0 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:14.610508 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-dcf1e9ea-651e-4576-a037-6e9916da8da0 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:14.611351 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-dcf1e9ea-651e-4576-a037-6e9916da8da0 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:14.611789 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-dcf1e9ea-651e-4576-a037-6e9916da8da0 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:14.616204 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2f44bf2d-d618-4598-945e-5174606f9d45 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:14.616853 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2f44bf2d-d618-4598-945e-5174606f9d45 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:14.617661 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2f44bf2d-d618-4598-945e-5174606f9d45 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:14.618088 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2f44bf2d-d618-4598-945e-5174606f9d45 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:14.644290 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-2f44bf2d-d618-4598-945e-5174606f9d45 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a/ips" status: 200 len: 150 microversion: 2.1 time: 0.054103 May 30 12:06:14.645379 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 156/316] 10.222.0.32 () {58 vars in 1247 bytes} [Mon May 30 12:06:14 2022] GET /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a/ips => generated 150 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:06:14.756306 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-dcf1e9ea-651e-4576-a037-6e9916da8da0 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76e8d7bfdc04ea79c83ca7fb6b9ade1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5074cf3e6248668995f266845c8969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:14.772210 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-dcf1e9ea-651e-4576-a037-6e9916da8da0 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed" status: 200 len: 1723 microversion: 2.1 time: 0.179121 May 30 12:06:14.773382 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 161/317] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:14 2022] GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:06:15.456476 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-8d6e046d-a8d2-448c-86cd-a6e2fa21a4cf tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-326940499", "imageRef": "b8ef93ed-af98-4d8c-9e1d-43d7b1f2b832", "flavorRef": "452", "networks": [{"uuid": "74823171-a713-4723-823f-3ac14207cc72"}]}} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:06:15.532420 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.network.neutron [None req-8d6e046d-a8d2-448c-86cd-a6e2fa21a4cf tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] validate_networks() for [('74823171-a713-4723-823f-3ac14207cc72', None, None, None, None, None)] {{(pid=117670) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 30 12:06:15.617343 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-d1351eab-c023-4933-99d3-df05c701f297 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:15.618059 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-d1351eab-c023-4933-99d3-df05c701f297 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: dcdae5e3-81e8-412d-9e2a-0a481c13b57b] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:15.625582 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d1351eab-c023-4933-99d3-df05c701f297 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:15.627256 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d1351eab-c023-4933-99d3-df05c701f297 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:15.628118 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d1351eab-c023-4933-99d3-df05c701f297 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:15.628642 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d1351eab-c023-4933-99d3-df05c701f297 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:16.108678 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-d1351eab-c023-4933-99d3-df05c701f297 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:16.117527 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-d1351eab-c023-4933-99d3-df05c701f297 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b" status: 200 len: 1510 microversion: 2.1 time: 0.515566 May 30 12:06:16.118357 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 162/318] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:15 2022] GET /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b => generated 1510 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:06:16.123057 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-5007404c-6d95-40aa-8df0-103a21491119 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:16.123988 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-5007404c-6d95-40aa-8df0-103a21491119 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:16.130424 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5007404c-6d95-40aa-8df0-103a21491119 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:16.130880 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5007404c-6d95-40aa-8df0-103a21491119 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:16.131651 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5007404c-6d95-40aa-8df0-103a21491119 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:16.132281 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5007404c-6d95-40aa-8df0-103a21491119 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:16.304533 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-8d6e046d-a8d2-448c-86cd-a6e2fa21a4cf tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Flavor limits 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 30 12:06:16.304945 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-8d6e046d-a8d2-448c-86cd-a6e2fa21a4cf tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Image limits 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 30 12:06:16.305595 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-8d6e046d-a8d2-448c-86cd-a6e2fa21a4cf tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Flavor pref 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 30 12:06:16.305999 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-8d6e046d-a8d2-448c-86cd-a6e2fa21a4cf tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Image pref 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 30 12:06:16.306666 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-8d6e046d-a8d2-448c-86cd-a6e2fa21a4cf tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 30 12:06:16.318159 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8d6e046d-a8d2-448c-86cd-a6e2fa21a4cf tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:16.318775 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8d6e046d-a8d2-448c-86cd-a6e2fa21a4cf tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:16.319773 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8d6e046d-a8d2-448c-86cd-a6e2fa21a4cf tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:16.320405 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8d6e046d-a8d2-448c-86cd-a6e2fa21a4cf tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:16.340102 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-5007404c-6d95-40aa-8df0-103a21491119 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:16.349604 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.quota [None req-8d6e046d-a8d2-448c-86cd-a6e2fa21a4cf tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Getting quotas for project 94cd1e0377594f52bb5bfa7159731d48. Resources: {'cores', 'instances', 'ram'} {{(pid=117670) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 30 12:06:16.354162 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-5007404c-6d95-40aa-8df0-103a21491119 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:16.356664 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-5007404c-6d95-40aa-8df0-103a21491119 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:16.357867 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-5007404c-6d95-40aa-8df0-103a21491119 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1723 microversion: 2.20 time: 0.238438 May 30 12:06:16.358409 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 163/319] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:06:16 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1723 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:06:16.361889 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.quota [None req-8d6e046d-a8d2-448c-86cd-a6e2fa21a4cf tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Getting quotas for user 1d4c83a1ccfc43beb3f48e4462b06794 and project 94cd1e0377594f52bb5bfa7159731d48. Resources: {'cores', 'instances', 'ram'} {{(pid=117670) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 30 12:06:16.369912 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-7d86aa79-6ca1-4e06-b955-7ebe71374d1d tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:16.370796 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-7d86aa79-6ca1-4e06-b955-7ebe71374d1d tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 08b1b860-516e-4041-8df8-1fa8cc65a4ed] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:16.377797 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7d86aa79-6ca1-4e06-b955-7ebe71374d1d tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:16.378476 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7d86aa79-6ca1-4e06-b955-7ebe71374d1d tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:16.379415 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7d86aa79-6ca1-4e06-b955-7ebe71374d1d tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:16.380032 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7d86aa79-6ca1-4e06-b955-7ebe71374d1d tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:16.386561 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-8d6e046d-a8d2-448c-86cd-a6e2fa21a4cf tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Going to run 1 instances... {{(pid=117670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 30 12:06:16.389023 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-8d6e046d-a8d2-448c-86cd-a6e2fa21a4cf tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] [instance: 11600577-2336-4fdd-b0f0-78fbf42f8ea1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b8ef93ed-af98-4d8c-9e1d-43d7b1f2b832',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 30 12:06:16.470849 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-8d6e046d-a8d2-448c-86cd-a6e2fa21a4cf tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.018607 May 30 12:06:16.478202 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 157/320] 10.222.0.32 () {60 vars in 1146 bytes} [Mon May 30 12:06:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1027 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 30 12:06:16.485240 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-245bd692-ed97-4206-ba70-fb009474eabd tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "55d71715-3141-49dc-bb9c-8223542716fa"}} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:06:16.486830 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-245bd692-ed97-4206-ba70-fb009474eabd tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: 54ad4de0-2282-4baf-86a4-40d5ba1ba62a] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:16.495480 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-245bd692-ed97-4206-ba70-fb009474eabd tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:16.496113 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-245bd692-ed97-4206-ba70-fb009474eabd tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:16.497172 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-245bd692-ed97-4206-ba70-fb009474eabd tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:16.497822 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-245bd692-ed97-4206-ba70-fb009474eabd tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:16.534289 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell1:SELECT=100 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:16.558122 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-7d86aa79-6ca1-4e06-b955-7ebe71374d1d tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76e8d7bfdc04ea79c83ca7fb6b9ade1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5074cf3e6248668995f266845c8969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:16.585980 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-7d86aa79-6ca1-4e06-b955-7ebe71374d1d tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed" status: 200 len: 1723 microversion: 2.1 time: 0.219053 May 30 12:06:16.586916 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 164/321] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:16 2022] GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed => generated 1723 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:06:16.610363 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-69bc5cad-6c00-4d8d-a549-181f5be3b4c4 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:16.615474 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-69bc5cad-6c00-4d8d-a549-181f5be3b4c4 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] [instance: 11600577-2336-4fdd-b0f0-78fbf42f8ea1] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:16.687004 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-69bc5cad-6c00-4d8d-a549-181f5be3b4c4 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4c83a1ccfc43beb3f48e4462b06794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cd1e0377594f52bb5bfa7159731d48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:16.694831 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-69bc5cad-6c00-4d8d-a549-181f5be3b4c4 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] 10.222.0.32 "GET /compute/v2.1/servers/11600577-2336-4fdd-b0f0-78fbf42f8ea1" status: 200 len: 1218 microversion: 2.1 time: 0.088230 May 30 12:06:16.695784 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 165/322] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:16 2022] GET /compute/v2.1/servers/11600577-2336-4fdd-b0f0-78fbf42f8ea1 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:06:17.161242 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-3bacd155-f353-46a2-b8f4-d92ec746e947 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:17.161868 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-3bacd155-f353-46a2-b8f4-d92ec746e947 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: dcdae5e3-81e8-412d-9e2a-0a481c13b57b] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:17.183581 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3bacd155-f353-46a2-b8f4-d92ec746e947 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:17.184043 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3bacd155-f353-46a2-b8f4-d92ec746e947 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:17.184955 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3bacd155-f353-46a2-b8f4-d92ec746e947 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:17.185405 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3bacd155-f353-46a2-b8f4-d92ec746e947 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:17.364741 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-3bacd155-f353-46a2-b8f4-d92ec746e947 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:17.374682 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-3bacd155-f353-46a2-b8f4-d92ec746e947 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b" status: 200 len: 1510 microversion: 2.1 time: 0.242693 May 30 12:06:17.376453 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 166/323] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:17 2022] GET /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b => generated 1510 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:06:17.383049 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-0c1aa9ec-c3d0-430c-aefd-3249cf70bc9d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:17.384321 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-0c1aa9ec-c3d0-430c-aefd-3249cf70bc9d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:17.392311 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0c1aa9ec-c3d0-430c-aefd-3249cf70bc9d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:17.393190 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0c1aa9ec-c3d0-430c-aefd-3249cf70bc9d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:17.394470 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0c1aa9ec-c3d0-430c-aefd-3249cf70bc9d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:17.395692 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0c1aa9ec-c3d0-430c-aefd-3249cf70bc9d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:17.561632 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-0c1aa9ec-c3d0-430c-aefd-3249cf70bc9d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:17.571859 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-0c1aa9ec-c3d0-430c-aefd-3249cf70bc9d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:17.573613 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-0c1aa9ec-c3d0-430c-aefd-3249cf70bc9d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:17.574977 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-0c1aa9ec-c3d0-430c-aefd-3249cf70bc9d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1723 microversion: 2.20 time: 0.196897 May 30 12:06:17.575795 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 167/324] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:06:17 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1723 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:06:17.603944 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-373baec7-c9f3-43b3-8ffc-7cbca9d918c6 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:17.604672 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-373baec7-c9f3-43b3-8ffc-7cbca9d918c6 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 08b1b860-516e-4041-8df8-1fa8cc65a4ed] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:17.612262 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-373baec7-c9f3-43b3-8ffc-7cbca9d918c6 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:17.612992 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-373baec7-c9f3-43b3-8ffc-7cbca9d918c6 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:17.614008 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-373baec7-c9f3-43b3-8ffc-7cbca9d918c6 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:17.614525 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-373baec7-c9f3-43b3-8ffc-7cbca9d918c6 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:17.797312 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-373baec7-c9f3-43b3-8ffc-7cbca9d918c6 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76e8d7bfdc04ea79c83ca7fb6b9ade1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5074cf3e6248668995f266845c8969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:17.809336 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-373baec7-c9f3-43b3-8ffc-7cbca9d918c6 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed" status: 200 len: 1723 microversion: 2.1 time: 0.208747 May 30 12:06:17.810709 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 168/325] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:17 2022] GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed => generated 1723 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:06:17.819472 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-00d8b0e2-dbf3-4339-b0c5-3fb76e5cc07f tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:17.821065 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-00d8b0e2-dbf3-4339-b0c5-3fb76e5cc07f tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] [instance: 11600577-2336-4fdd-b0f0-78fbf42f8ea1] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:17.829975 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-00d8b0e2-dbf3-4339-b0c5-3fb76e5cc07f tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:17.830829 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-00d8b0e2-dbf3-4339-b0c5-3fb76e5cc07f tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:17.832511 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-00d8b0e2-dbf3-4339-b0c5-3fb76e5cc07f tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:17.833644 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-00d8b0e2-dbf3-4339-b0c5-3fb76e5cc07f tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:17.928987 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-00d8b0e2-dbf3-4339-b0c5-3fb76e5cc07f tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4c83a1ccfc43beb3f48e4462b06794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cd1e0377594f52bb5bfa7159731d48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:17.943196 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-00d8b0e2-dbf3-4339-b0c5-3fb76e5cc07f tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] 10.222.0.32 "GET /compute/v2.1/servers/11600577-2336-4fdd-b0f0-78fbf42f8ea1" status: 200 len: 1222 microversion: 2.1 time: 0.130946 May 30 12:06:17.947342 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 169/326] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:17 2022] GET /compute/v2.1/servers/11600577-2336-4fdd-b0f0-78fbf42f8ea1 => generated 1222 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:06:18.026123 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-245bd692-ed97-4206-ba70-fb009474eabd tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "POST /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.546275 May 30 12:06:18.028358 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 158/327] 10.222.0.32 () {60 vars in 1322 bytes} [Mon May 30 12:06:16 2022] POST /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a/os-volume_attachments => generated 194 bytes in 1549 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:06:18.395205 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-19bd3caa-c928-4e06-98bd-efff028f743f tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:18.395821 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-19bd3caa-c928-4e06-98bd-efff028f743f tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: dcdae5e3-81e8-412d-9e2a-0a481c13b57b] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:18.401962 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-19bd3caa-c928-4e06-98bd-efff028f743f tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:18.402645 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-19bd3caa-c928-4e06-98bd-efff028f743f tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:18.403765 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-19bd3caa-c928-4e06-98bd-efff028f743f tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:18.404150 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-19bd3caa-c928-4e06-98bd-efff028f743f tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:18.406956 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:18.594618 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-19bd3caa-c928-4e06-98bd-efff028f743f tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:18.599625 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-fc707019-0c0c-4bb6-b1d4-489f64fecadd tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:18.601846 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-fc707019-0c0c-4bb6-b1d4-489f64fecadd tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:18.610446 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-fc707019-0c0c-4bb6-b1d4-489f64fecadd tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:18.611200 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-fc707019-0c0c-4bb6-b1d4-489f64fecadd tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:18.612190 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-fc707019-0c0c-4bb6-b1d4-489f64fecadd tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:18.612610 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-fc707019-0c0c-4bb6-b1d4-489f64fecadd tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:18.616553 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-19bd3caa-c928-4e06-98bd-efff028f743f tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b" status: 200 len: 1510 microversion: 2.1 time: 0.225425 May 30 12:06:18.617139 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 170/328] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:18 2022] GET /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b => generated 1510 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:06:18.828450 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-df5eff66-73fa-4441-8177-894bedfe91be tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:18.829901 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-df5eff66-73fa-4441-8177-894bedfe91be tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 08b1b860-516e-4041-8df8-1fa8cc65a4ed] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:18.837391 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-df5eff66-73fa-4441-8177-894bedfe91be tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:18.838724 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-df5eff66-73fa-4441-8177-894bedfe91be tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:18.839926 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-df5eff66-73fa-4441-8177-894bedfe91be tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:18.840553 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-df5eff66-73fa-4441-8177-894bedfe91be tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:18.853304 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-fc707019-0c0c-4bb6-b1d4-489f64fecadd tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:18.864479 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-fc707019-0c0c-4bb6-b1d4-489f64fecadd tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:18.866545 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-fc707019-0c0c-4bb6-b1d4-489f64fecadd tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:18.868212 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-fc707019-0c0c-4bb6-b1d4-489f64fecadd tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1723 microversion: 2.20 time: 0.277649 May 30 12:06:18.880438 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 159/329] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:06:18 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1723 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 30 12:06:18.961178 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-4c886aa8-9370-4df1-aeb7-e9cc9d690d19 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:18.961901 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-4c886aa8-9370-4df1-aeb7-e9cc9d690d19 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] [instance: 11600577-2336-4fdd-b0f0-78fbf42f8ea1] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:18.973914 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4c886aa8-9370-4df1-aeb7-e9cc9d690d19 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:18.974304 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4c886aa8-9370-4df1-aeb7-e9cc9d690d19 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:18.976092 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4c886aa8-9370-4df1-aeb7-e9cc9d690d19 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:18.976752 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4c886aa8-9370-4df1-aeb7-e9cc9d690d19 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:19.058188 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-df5eff66-73fa-4441-8177-894bedfe91be tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76e8d7bfdc04ea79c83ca7fb6b9ade1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5074cf3e6248668995f266845c8969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:19.070772 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-df5eff66-73fa-4441-8177-894bedfe91be tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed" status: 200 len: 1723 microversion: 2.1 time: 0.247184 May 30 12:06:19.072049 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 171/330] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:18 2022] GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed => generated 1723 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:06:19.097863 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-4c886aa8-9370-4df1-aeb7-e9cc9d690d19 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4c83a1ccfc43beb3f48e4462b06794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cd1e0377594f52bb5bfa7159731d48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:19.111728 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-4c886aa8-9370-4df1-aeb7-e9cc9d690d19 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] 10.222.0.32 "GET /compute/v2.1/servers/11600577-2336-4fdd-b0f0-78fbf42f8ea1" status: 200 len: 1270 microversion: 2.1 time: 0.150905 May 30 12:06:19.112451 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 160/331] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:18 2022] GET /compute/v2.1/servers/11600577-2336-4fdd-b0f0-78fbf42f8ea1 => generated 1270 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:06:19.634946 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-d901d991-fd6d-4e6a-9a3c-afaac49080fe tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:19.636255 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-d901d991-fd6d-4e6a-9a3c-afaac49080fe tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: dcdae5e3-81e8-412d-9e2a-0a481c13b57b] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:19.644286 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d901d991-fd6d-4e6a-9a3c-afaac49080fe tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:19.645531 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d901d991-fd6d-4e6a-9a3c-afaac49080fe tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:19.646770 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d901d991-fd6d-4e6a-9a3c-afaac49080fe tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:19.648369 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d901d991-fd6d-4e6a-9a3c-afaac49080fe tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:19.880891 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-d901d991-fd6d-4e6a-9a3c-afaac49080fe tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:19.889282 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-d3661e85-09ad-4515-8b53-a658555ca514 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:19.891779 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-d3661e85-09ad-4515-8b53-a658555ca514 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:19.905598 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-d901d991-fd6d-4e6a-9a3c-afaac49080fe tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b" status: 200 len: 1516 microversion: 2.1 time: 0.273836 May 30 12:06:19.907914 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d3661e85-09ad-4515-8b53-a658555ca514 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:19.908754 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 172/332] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:19 2022] GET /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b => generated 1516 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:06:19.909391 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d3661e85-09ad-4515-8b53-a658555ca514 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:19.910403 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d3661e85-09ad-4515-8b53-a658555ca514 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:19.910993 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d3661e85-09ad-4515-8b53-a658555ca514 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:20.089737 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-6f05c59b-596d-4fa3-9745-296dcc0c1685 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:20.090347 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-6f05c59b-596d-4fa3-9745-296dcc0c1685 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 08b1b860-516e-4041-8df8-1fa8cc65a4ed] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:20.101524 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-6f05c59b-596d-4fa3-9745-296dcc0c1685 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:20.102035 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-6f05c59b-596d-4fa3-9745-296dcc0c1685 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:20.105299 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-6f05c59b-596d-4fa3-9745-296dcc0c1685 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:20.106166 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-6f05c59b-596d-4fa3-9745-296dcc0c1685 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:20.175345 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-d3661e85-09ad-4515-8b53-a658555ca514 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:20.213019 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-d3661e85-09ad-4515-8b53-a658555ca514 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:20.220022 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-d3661e85-09ad-4515-8b53-a658555ca514 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:20.226323 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-d3661e85-09ad-4515-8b53-a658555ca514 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1723 microversion: 2.20 time: 0.337386 May 30 12:06:20.241101 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 161/333] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:06:19 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1723 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 30 12:06:20.246383 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-06042b4a-f36c-477c-8cbe-8ace6513d309 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:20.248018 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-06042b4a-f36c-477c-8cbe-8ace6513d309 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] [instance: 11600577-2336-4fdd-b0f0-78fbf42f8ea1] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:20.273799 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-06042b4a-f36c-477c-8cbe-8ace6513d309 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:20.274515 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-06042b4a-f36c-477c-8cbe-8ace6513d309 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:20.275904 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-06042b4a-f36c-477c-8cbe-8ace6513d309 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:20.277685 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-06042b4a-f36c-477c-8cbe-8ace6513d309 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:20.585300 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-6f05c59b-596d-4fa3-9745-296dcc0c1685 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76e8d7bfdc04ea79c83ca7fb6b9ade1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5074cf3e6248668995f266845c8969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:20.598638 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-6f05c59b-596d-4fa3-9745-296dcc0c1685 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed" status: 200 len: 1723 microversion: 2.1 time: 0.512771 May 30 12:06:20.612511 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 173/334] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:20 2022] GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed => generated 1723 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:06:20.697238 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-06042b4a-f36c-477c-8cbe-8ace6513d309 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4c83a1ccfc43beb3f48e4462b06794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cd1e0377594f52bb5bfa7159731d48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:20.707686 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-06042b4a-f36c-477c-8cbe-8ace6513d309 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] 10.222.0.32 "GET /compute/v2.1/servers/11600577-2336-4fdd-b0f0-78fbf42f8ea1" status: 200 len: 1318 microversion: 2.1 time: 0.465125 May 30 12:06:20.711914 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 162/335] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:20 2022] GET /compute/v2.1/servers/11600577-2336-4fdd-b0f0-78fbf42f8ea1 => generated 1318 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:06:21.248868 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-ea53030a-3c79-49dd-a28c-4f39c62d341e tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:21.250295 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-ea53030a-3c79-49dd-a28c-4f39c62d341e tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:21.260477 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ea53030a-3c79-49dd-a28c-4f39c62d341e tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:21.268527 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ea53030a-3c79-49dd-a28c-4f39c62d341e tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:21.270858 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ea53030a-3c79-49dd-a28c-4f39c62d341e tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:21.271548 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ea53030a-3c79-49dd-a28c-4f39c62d341e tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:21.495469 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-ea53030a-3c79-49dd-a28c-4f39c62d341e tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:21.506301 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-ea53030a-3c79-49dd-a28c-4f39c62d341e tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:21.508339 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-ea53030a-3c79-49dd-a28c-4f39c62d341e tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:21.509971 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-ea53030a-3c79-49dd-a28c-4f39c62d341e tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1723 microversion: 2.20 time: 0.266829 May 30 12:06:21.523159 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 174/336] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:06:21 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1723 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:06:21.568083 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-0cb28d80-5cc4-4f32-a4d3-1436a2923845 req-790ae0d0-b583-4908-992c-8ad57ce2a34a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11600577-2336-4fdd-b0f0-78fbf42f8ea1", "tag": "de5378e4-4146-4fbc-9827-83be39fbf054"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:06:21.607803 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-0cb28d80-5cc4-4f32-a4d3-1436a2923845 req-790ae0d0-b583-4908-992c-8ad57ce2a34a service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:21.609157 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-0cb28d80-5cc4-4f32-a4d3-1436a2923845 req-790ae0d0-b583-4908-992c-8ad57ce2a34a service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:21.619628 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-9cbf86ca-0c9f-4d36-a7f3-de38ddfe8741 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:21.620585 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-9cbf86ca-0c9f-4d36-a7f3-de38ddfe8741 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 08b1b860-516e-4041-8df8-1fa8cc65a4ed] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:21.635925 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9cbf86ca-0c9f-4d36-a7f3-de38ddfe8741 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:21.636432 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9cbf86ca-0c9f-4d36-a7f3-de38ddfe8741 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:21.637230 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9cbf86ca-0c9f-4d36-a7f3-de38ddfe8741 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:21.637865 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9cbf86ca-0c9f-4d36-a7f3-de38ddfe8741 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:21.645433 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-0cb28d80-5cc4-4f32-a4d3-1436a2923845 req-790ae0d0-b583-4908-992c-8ad57ce2a34a service nova] Creating event network-changed:de5378e4-4146-4fbc-9827-83be39fbf054 for instance 11600577-2336-4fdd-b0f0-78fbf42f8ea1 on hv-cinder-84051 May 30 12:06:21.666951 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-0cb28d80-5cc4-4f32-a4d3-1436a2923845 req-790ae0d0-b583-4908-992c-8ad57ce2a34a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101952 May 30 12:06:21.669456 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 163/337] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:06:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:06:21.727089 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-2fdcf09b-35e8-4d1a-8d6d-655da6fca9ee tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:21.727965 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-2fdcf09b-35e8-4d1a-8d6d-655da6fca9ee tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] [instance: 11600577-2336-4fdd-b0f0-78fbf42f8ea1] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:21.759107 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2fdcf09b-35e8-4d1a-8d6d-655da6fca9ee tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:21.759858 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2fdcf09b-35e8-4d1a-8d6d-655da6fca9ee tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:21.760959 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2fdcf09b-35e8-4d1a-8d6d-655da6fca9ee tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:21.761606 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2fdcf09b-35e8-4d1a-8d6d-655da6fca9ee tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:21.815178 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-9cbf86ca-0c9f-4d36-a7f3-de38ddfe8741 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76e8d7bfdc04ea79c83ca7fb6b9ade1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5074cf3e6248668995f266845c8969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:21.831046 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-9cbf86ca-0c9f-4d36-a7f3-de38ddfe8741 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed" status: 200 len: 1723 microversion: 2.1 time: 0.209621 May 30 12:06:21.832059 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 175/338] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:21 2022] GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed => generated 1723 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:06:21.839285 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-6ebd722f-650a-48b3-a9c7-ea0d1cb9501a tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Action: 'create', calling method: .version_select at 0x7f0ef89af4c0>, body: {"keypair": {"name": "tempest-keypair-1845223960", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFdkHobNjZifgvFEdYvZjRoQOPB/LZPiqC3PwxoAD33nEOOPprNSI3DA9TicbTal2Z3+EdBPZD2YE7uFBkkFSo5ADBqo0A1398jGv9PBCnM67R6nh6HLjOH6AAXfSk7daw=="}} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:06:21.870140 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.quota [None req-6ebd722f-650a-48b3-a9c7-ea0d1cb9501a tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Getting quotas for project c988db8e79bf4c98ac288105177f90f2. Resources: {'key_pairs'} {{(pid=117671) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 30 12:06:21.875297 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.quota [None req-6ebd722f-650a-48b3-a9c7-ea0d1cb9501a tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Getting quotas for user 166b42a5d6c04659afb20c088dfead76 and project c988db8e79bf4c98ac288105177f90f2. Resources: {'key_pairs'} {{(pid=117671) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 30 12:06:21.903549 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-6ebd722f-650a-48b3-a9c7-ea0d1cb9501a tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.070230 May 30 12:06:21.904406 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 176/339] 10.222.0.32 () {60 vars in 1158 bytes} [Mon May 30 12:06:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:06:21.989878 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-2fdcf09b-35e8-4d1a-8d6d-655da6fca9ee tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4c83a1ccfc43beb3f48e4462b06794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cd1e0377594f52bb5bfa7159731d48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:22.002572 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-2fdcf09b-35e8-4d1a-8d6d-655da6fca9ee tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] 10.222.0.32 "GET /compute/v2.1/servers/11600577-2336-4fdd-b0f0-78fbf42f8ea1" status: 200 len: 1318 microversion: 2.1 time: 0.280739 May 30 12:06:22.003788 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 164/340] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:21 2022] GET /compute/v2.1/servers/11600577-2336-4fdd-b0f0-78fbf42f8ea1 => generated 1318 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:06:22.531155 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-0f7dbd9c-ebc5-471c-9154-0a64ed6e3365 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:22.531871 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-0f7dbd9c-ebc5-471c-9154-0a64ed6e3365 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:22.539319 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0f7dbd9c-ebc5-471c-9154-0a64ed6e3365 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:22.540136 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0f7dbd9c-ebc5-471c-9154-0a64ed6e3365 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:22.541143 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0f7dbd9c-ebc5-471c-9154-0a64ed6e3365 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:22.541757 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0f7dbd9c-ebc5-471c-9154-0a64ed6e3365 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:22.749780 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-0f7dbd9c-ebc5-471c-9154-0a64ed6e3365 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:22.762630 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-0f7dbd9c-ebc5-471c-9154-0a64ed6e3365 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:22.764431 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-0f7dbd9c-ebc5-471c-9154-0a64ed6e3365 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:22.766056 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-0f7dbd9c-ebc5-471c-9154-0a64ed6e3365 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1723 microversion: 2.20 time: 0.239362 May 30 12:06:22.778424 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 177/341] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:06:22 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1723 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:06:22.848104 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-612b0d93-cc47-4a89-affb-4a349b593259 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:22.849473 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-612b0d93-cc47-4a89-affb-4a349b593259 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 08b1b860-516e-4041-8df8-1fa8cc65a4ed] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:22.860877 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-612b0d93-cc47-4a89-affb-4a349b593259 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:22.861579 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-612b0d93-cc47-4a89-affb-4a349b593259 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:22.862392 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-612b0d93-cc47-4a89-affb-4a349b593259 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:22.862824 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-612b0d93-cc47-4a89-affb-4a349b593259 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:23.020982 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-c5899b12-5df7-480f-b7c6-1a7cc8659ba3 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:23.024547 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-c5899b12-5df7-480f-b7c6-1a7cc8659ba3 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] [instance: 11600577-2336-4fdd-b0f0-78fbf42f8ea1] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:23.034547 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c5899b12-5df7-480f-b7c6-1a7cc8659ba3 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:23.038069 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c5899b12-5df7-480f-b7c6-1a7cc8659ba3 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:23.039184 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c5899b12-5df7-480f-b7c6-1a7cc8659ba3 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:23.040278 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c5899b12-5df7-480f-b7c6-1a7cc8659ba3 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:23.102537 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-612b0d93-cc47-4a89-affb-4a349b593259 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76e8d7bfdc04ea79c83ca7fb6b9ade1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5074cf3e6248668995f266845c8969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:23.108038 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-612b0d93-cc47-4a89-affb-4a349b593259 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed" status: 200 len: 1723 microversion: 2.1 time: 0.263727 May 30 12:06:23.109125 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 165/342] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:22 2022] GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed => generated 1723 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:06:23.327293 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-c5899b12-5df7-480f-b7c6-1a7cc8659ba3 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4c83a1ccfc43beb3f48e4462b06794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cd1e0377594f52bb5bfa7159731d48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:23.335759 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-c5899b12-5df7-480f-b7c6-1a7cc8659ba3 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] 10.222.0.32 "GET /compute/v2.1/servers/11600577-2336-4fdd-b0f0-78fbf42f8ea1" status: 200 len: 1318 microversion: 2.1 time: 0.320240 May 30 12:06:23.345910 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 178/343] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:23 2022] GET /compute/v2.1/servers/11600577-2336-4fdd-b0f0-78fbf42f8ea1 => generated 1318 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:06:23.785546 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-15b012ce-18e0-4484-a7a7-dfdd87c87bad tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:23.786520 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-15b012ce-18e0-4484-a7a7-dfdd87c87bad tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:23.789215 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:23.798119 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-15b012ce-18e0-4484-a7a7-dfdd87c87bad tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:23.798861 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-15b012ce-18e0-4484-a7a7-dfdd87c87bad tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:23.800107 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-15b012ce-18e0-4484-a7a7-dfdd87c87bad tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:23.800859 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-15b012ce-18e0-4484-a7a7-dfdd87c87bad tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:24.013586 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-15b012ce-18e0-4484-a7a7-dfdd87c87bad tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:24.026042 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-15b012ce-18e0-4484-a7a7-dfdd87c87bad tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:24.027579 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-15b012ce-18e0-4484-a7a7-dfdd87c87bad tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:24.028807 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-15b012ce-18e0-4484-a7a7-dfdd87c87bad tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1723 microversion: 2.20 time: 0.247345 May 30 12:06:24.040842 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 166/344] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:06:23 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1723 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:06:24.129876 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-28e29b01-a409-4c2b-b270-b75d481fcd70 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:24.131773 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-28e29b01-a409-4c2b-b270-b75d481fcd70 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 08b1b860-516e-4041-8df8-1fa8cc65a4ed] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:24.140970 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:24.144962 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-28e29b01-a409-4c2b-b270-b75d481fcd70 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:24.145640 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-28e29b01-a409-4c2b-b270-b75d481fcd70 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:24.147023 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-28e29b01-a409-4c2b-b270-b75d481fcd70 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:24.147622 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-28e29b01-a409-4c2b-b270-b75d481fcd70 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:24.354492 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-d344e54c-0eb3-42a0-b424-41ca01669deb tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:24.355620 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-d344e54c-0eb3-42a0-b424-41ca01669deb tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] [instance: 11600577-2336-4fdd-b0f0-78fbf42f8ea1] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:24.368913 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d344e54c-0eb3-42a0-b424-41ca01669deb tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:24.369795 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d344e54c-0eb3-42a0-b424-41ca01669deb tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:24.377911 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d344e54c-0eb3-42a0-b424-41ca01669deb tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:24.378799 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d344e54c-0eb3-42a0-b424-41ca01669deb tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:24.384070 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-28e29b01-a409-4c2b-b270-b75d481fcd70 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76e8d7bfdc04ea79c83ca7fb6b9ade1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5074cf3e6248668995f266845c8969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:24.392718 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-28e29b01-a409-4c2b-b270-b75d481fcd70 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed" status: 200 len: 1723 microversion: 2.1 time: 0.269981 May 30 12:06:24.394110 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 179/345] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:24 2022] GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed => generated 1723 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:06:24.400332 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-cda0457a-9f0a-4466-8474-0b3c2198459e tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2050345773", "imageRef": "b8ef93ed-af98-4d8c-9e1d-43d7b1f2b832", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1df1af59-dc4a-4ec6-926a-e35a4841adfa"}], "security_groups": [{"name": "tempest-securitygroup--1647392212"}], "key_name": "tempest-keypair-1845223960", "user_data": "}} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:06:24.592320 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.network.neutron [None req-cda0457a-9f0a-4466-8474-0b3c2198459e tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] validate_networks() for [('1df1af59-dc4a-4ec6-926a-e35a4841adfa', None, None, None, None, None)] {{(pid=117671) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 30 12:06:24.607122 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-d344e54c-0eb3-42a0-b424-41ca01669deb tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4c83a1ccfc43beb3f48e4462b06794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cd1e0377594f52bb5bfa7159731d48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:24.618632 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-d344e54c-0eb3-42a0-b424-41ca01669deb tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] 10.222.0.32 "GET /compute/v2.1/servers/11600577-2336-4fdd-b0f0-78fbf42f8ea1" status: 200 len: 1318 microversion: 2.1 time: 0.268554 May 30 12:06:24.629921 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 167/346] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:24 2022] GET /compute/v2.1/servers/11600577-2336-4fdd-b0f0-78fbf42f8ea1 => generated 1318 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:06:25.050851 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-fdb29eca-07f5-4aa6-858d-43d1d571a6da tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:25.052365 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-fdb29eca-07f5-4aa6-858d-43d1d571a6da tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:25.061628 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-fdb29eca-07f5-4aa6-858d-43d1d571a6da tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:25.062810 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-fdb29eca-07f5-4aa6-858d-43d1d571a6da tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:25.064004 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-fdb29eca-07f5-4aa6-858d-43d1d571a6da tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:25.064665 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-fdb29eca-07f5-4aa6-858d-43d1d571a6da tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:25.084450 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-cda0457a-9f0a-4466-8474-0b3c2198459e tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Flavor limits 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 30 12:06:25.084879 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-cda0457a-9f0a-4466-8474-0b3c2198459e tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Image limits 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 30 12:06:25.085357 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-cda0457a-9f0a-4466-8474-0b3c2198459e tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Flavor pref 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 30 12:06:25.085762 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-cda0457a-9f0a-4466-8474-0b3c2198459e tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Image pref 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 30 12:06:25.086180 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-cda0457a-9f0a-4466-8474-0b3c2198459e tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 30 12:06:25.096933 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-cda0457a-9f0a-4466-8474-0b3c2198459e tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:25.097411 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-cda0457a-9f0a-4466-8474-0b3c2198459e tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:25.098346 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-cda0457a-9f0a-4466-8474-0b3c2198459e tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:25.098817 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-cda0457a-9f0a-4466-8474-0b3c2198459e tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:25.124200 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.quota [None req-cda0457a-9f0a-4466-8474-0b3c2198459e tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Getting quotas for project c988db8e79bf4c98ac288105177f90f2. Resources: {'cores', 'instances', 'ram'} {{(pid=117671) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 30 12:06:25.130859 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.quota [None req-cda0457a-9f0a-4466-8474-0b3c2198459e tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Getting quotas for user 166b42a5d6c04659afb20c088dfead76 and project c988db8e79bf4c98ac288105177f90f2. Resources: {'cores', 'instances', 'ram'} {{(pid=117671) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 30 12:06:25.145678 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-cda0457a-9f0a-4466-8474-0b3c2198459e tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Going to run 1 instances... {{(pid=117671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 30 12:06:25.148377 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-cda0457a-9f0a-4466-8474-0b3c2198459e tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 83f672fe-d699-4f70-bc26-74dced714a5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b8ef93ed-af98-4d8c-9e1d-43d7b1f2b832',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 30 12:06:25.204721 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-cda0457a-9f0a-4466-8474-0b3c2198459e tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.808980 May 30 12:06:25.206118 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 180/347] 10.222.0.32 () {60 vars in 1146 bytes} [Mon May 30 12:06:24 2022] POST /compute/v2.1/servers => generated 409 bytes in 811 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 30 12:06:25.219653 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-cf6a1291-d756-4bf8-9d1f-b653a01f0f7a tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:25.220638 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-cf6a1291-d756-4bf8-9d1f-b653a01f0f7a tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 83f672fe-d699-4f70-bc26-74dced714a5d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:25.322318 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-cf6a1291-d756-4bf8-9d1f-b653a01f0f7a tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:25.342627 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-cf6a1291-d756-4bf8-9d1f-b653a01f0f7a tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d" status: 200 len: 1246 microversion: 2.1 time: 0.129145 May 30 12:06:25.344228 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-fdb29eca-07f5-4aa6-858d-43d1d571a6da tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:25.345965 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 181/348] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:25 2022] GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d => generated 1246 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:06:25.356697 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-fdb29eca-07f5-4aa6-858d-43d1d571a6da tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:25.359024 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-fdb29eca-07f5-4aa6-858d-43d1d571a6da tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:25.361647 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-fdb29eca-07f5-4aa6-858d-43d1d571a6da tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1723 microversion: 2.20 time: 0.316178 May 30 12:06:25.364480 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 168/349] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:06:25 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1723 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:06:25.411095 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-b4bf11ea-c82d-442b-8392-df2aa098981b tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:25.411722 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-b4bf11ea-c82d-442b-8392-df2aa098981b tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 08b1b860-516e-4041-8df8-1fa8cc65a4ed] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:25.418553 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b4bf11ea-c82d-442b-8392-df2aa098981b tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:25.419506 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b4bf11ea-c82d-442b-8392-df2aa098981b tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:25.422243 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b4bf11ea-c82d-442b-8392-df2aa098981b tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:25.423279 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b4bf11ea-c82d-442b-8392-df2aa098981b tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:25.636571 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-74d5c01b-8615-47ec-9a16-2a1a11556146 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:25.637477 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-74d5c01b-8615-47ec-9a16-2a1a11556146 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] [instance: 11600577-2336-4fdd-b0f0-78fbf42f8ea1] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:25.653286 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-74d5c01b-8615-47ec-9a16-2a1a11556146 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:25.654082 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-74d5c01b-8615-47ec-9a16-2a1a11556146 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:25.657604 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-74d5c01b-8615-47ec-9a16-2a1a11556146 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:25.659149 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-74d5c01b-8615-47ec-9a16-2a1a11556146 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:25.678015 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-b4bf11ea-c82d-442b-8392-df2aa098981b tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76e8d7bfdc04ea79c83ca7fb6b9ade1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5074cf3e6248668995f266845c8969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:25.692810 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-b4bf11ea-c82d-442b-8392-df2aa098981b tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed" status: 200 len: 1723 microversion: 2.1 time: 0.284864 May 30 12:06:25.693816 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 182/350] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:25 2022] GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed => generated 1723 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:06:25.863680 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-74d5c01b-8615-47ec-9a16-2a1a11556146 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4c83a1ccfc43beb3f48e4462b06794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cd1e0377594f52bb5bfa7159731d48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:25.872333 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-74d5c01b-8615-47ec-9a16-2a1a11556146 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] 10.222.0.32 "GET /compute/v2.1/servers/11600577-2336-4fdd-b0f0-78fbf42f8ea1" status: 200 len: 1318 microversion: 2.1 time: 0.239565 May 30 12:06:25.873183 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 169/351] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:25 2022] GET /compute/v2.1/servers/11600577-2336-4fdd-b0f0-78fbf42f8ea1 => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:06:26.362486 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-078cf1aa-cffb-4765-8418-5718a8bd2a24 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:26.363350 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-078cf1aa-cffb-4765-8418-5718a8bd2a24 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 83f672fe-d699-4f70-bc26-74dced714a5d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:26.373545 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-078cf1aa-cffb-4765-8418-5718a8bd2a24 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:26.374001 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-078cf1aa-cffb-4765-8418-5718a8bd2a24 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:26.375311 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-078cf1aa-cffb-4765-8418-5718a8bd2a24 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:26.376579 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-078cf1aa-cffb-4765-8418-5718a8bd2a24 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:26.382248 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-52f5096e-ab47-4790-8e72-55b4a4361bad tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:26.383619 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-52f5096e-ab47-4790-8e72-55b4a4361bad tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:26.388306 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell0:SELECT=2 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:26.394428 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell0:SELECT=6 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:26.416588 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-52f5096e-ab47-4790-8e72-55b4a4361bad tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:26.418217 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-52f5096e-ab47-4790-8e72-55b4a4361bad tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:26.420213 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-52f5096e-ab47-4790-8e72-55b4a4361bad tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:26.420900 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-52f5096e-ab47-4790-8e72-55b4a4361bad tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:26.483392 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-078cf1aa-cffb-4765-8418-5718a8bd2a24 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:26.494697 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-078cf1aa-cffb-4765-8418-5718a8bd2a24 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d" status: 200 len: 1242 microversion: 2.1 time: 0.134929 May 30 12:06:26.497624 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 183/352] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:26 2022] GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d => generated 1242 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:06:26.688565 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-52f5096e-ab47-4790-8e72-55b4a4361bad tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:26.699561 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-52f5096e-ab47-4790-8e72-55b4a4361bad tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:26.701125 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-52f5096e-ab47-4790-8e72-55b4a4361bad tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:26.702337 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-52f5096e-ab47-4790-8e72-55b4a4361bad tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1723 microversion: 2.20 time: 0.324484 May 30 12:06:26.710033 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-094cdecc-19b5-46c5-892d-d66e355b073c tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:26.710646 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-094cdecc-19b5-46c5-892d-d66e355b073c tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 08b1b860-516e-4041-8df8-1fa8cc65a4ed] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:26.722880 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-094cdecc-19b5-46c5-892d-d66e355b073c tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:26.723334 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-094cdecc-19b5-46c5-892d-d66e355b073c tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:26.724378 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-094cdecc-19b5-46c5-892d-d66e355b073c tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:26.724796 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 170/353] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:06:26 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1723 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:06:26.734854 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-094cdecc-19b5-46c5-892d-d66e355b073c tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:26.903023 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-aa7ca3d9-8ac6-4363-9b09-7c6ffbf44e75 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:26.903650 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-aa7ca3d9-8ac6-4363-9b09-7c6ffbf44e75 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] [instance: 11600577-2336-4fdd-b0f0-78fbf42f8ea1] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:26.939992 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-aa7ca3d9-8ac6-4363-9b09-7c6ffbf44e75 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:26.954276 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-aa7ca3d9-8ac6-4363-9b09-7c6ffbf44e75 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:26.957143 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-094cdecc-19b5-46c5-892d-d66e355b073c tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76e8d7bfdc04ea79c83ca7fb6b9ade1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5074cf3e6248668995f266845c8969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:26.958941 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-aa7ca3d9-8ac6-4363-9b09-7c6ffbf44e75 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:26.961415 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-aa7ca3d9-8ac6-4363-9b09-7c6ffbf44e75 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:26.968879 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-094cdecc-19b5-46c5-892d-d66e355b073c tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed" status: 200 len: 1723 microversion: 2.1 time: 0.261965 May 30 12:06:26.980104 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 184/354] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:26 2022] GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed => generated 1723 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:06:27.076817 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-c703475e-f654-4ec4-82d1-a17a1f0a6f2e tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Action: 'create', calling method: .version_select at 0x7f0ef892b4c0>, body: {"keypair": {"name": "tempest-keypair-937841626", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAHMnQV3Y5e0GHWklntp06XqxZ+kJd+EeSDNcQDw3M30ih3K+8oNeb5ap5RczTOCERpjL0pXiWwB6phrmReM7tzo73vhZ1eRdv9h+TN/VJLwBviit4UlNd5zAnhdxfpucw=="}} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:06:27.092019 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.quota [None req-c703475e-f654-4ec4-82d1-a17a1f0a6f2e tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Getting quotas for project 20763921c37c4e81bba702e09bf628b2. Resources: {'key_pairs'} {{(pid=117671) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 30 12:06:27.103338 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.quota [None req-c703475e-f654-4ec4-82d1-a17a1f0a6f2e tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Getting quotas for user 7575179edbda45208561c983fc5b956c and project 20763921c37c4e81bba702e09bf628b2. Resources: {'key_pairs'} {{(pid=117671) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 30 12:06:27.193564 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-c703475e-f654-4ec4-82d1-a17a1f0a6f2e tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.120409 May 30 12:06:27.194448 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 185/355] 10.222.0.32 () {60 vars in 1158 bytes} [Mon May 30 12:06:27 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:06:27.237908 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-aa7ca3d9-8ac6-4363-9b09-7c6ffbf44e75 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4c83a1ccfc43beb3f48e4462b06794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cd1e0377594f52bb5bfa7159731d48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:27.245678 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-aa7ca3d9-8ac6-4363-9b09-7c6ffbf44e75 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] 10.222.0.32 "GET /compute/v2.1/servers/11600577-2336-4fdd-b0f0-78fbf42f8ea1" status: 200 len: 1318 microversion: 2.1 time: 0.359679 May 30 12:06:27.250654 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 171/356] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:26 2022] GET /compute/v2.1/servers/11600577-2336-4fdd-b0f0-78fbf42f8ea1 => generated 1318 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:06:27.524122 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-3f1f6ffc-28a4-4b54-b640-fab14ba4d22b tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:27.525383 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-3f1f6ffc-28a4-4b54-b640-fab14ba4d22b tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 83f672fe-d699-4f70-bc26-74dced714a5d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:27.539429 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3f1f6ffc-28a4-4b54-b640-fab14ba4d22b tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:27.541689 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3f1f6ffc-28a4-4b54-b640-fab14ba4d22b tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:27.542847 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3f1f6ffc-28a4-4b54-b640-fab14ba4d22b tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:27.544898 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3f1f6ffc-28a4-4b54-b640-fab14ba4d22b tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:27.742182 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-9d015549-ee20-4038-96e1-1902c7f25fed tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:27.743591 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-9d015549-ee20-4038-96e1-1902c7f25fed tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:27.759718 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9d015549-ee20-4038-96e1-1902c7f25fed tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:27.766206 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9d015549-ee20-4038-96e1-1902c7f25fed tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:27.768835 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9d015549-ee20-4038-96e1-1902c7f25fed tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:27.775812 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9d015549-ee20-4038-96e1-1902c7f25fed tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:27.798734 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-3f1f6ffc-28a4-4b54-b640-fab14ba4d22b tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:27.815099 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-3f1f6ffc-28a4-4b54-b640-fab14ba4d22b tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d" status: 200 len: 1304 microversion: 2.1 time: 0.302690 May 30 12:06:27.830987 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 186/357] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:27 2022] GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d => generated 1304 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:06:27.988848 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-193d683a-0db9-477b-b173-ed46be742293 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:27.989739 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-193d683a-0db9-477b-b173-ed46be742293 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 08b1b860-516e-4041-8df8-1fa8cc65a4ed] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:28.007530 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-193d683a-0db9-477b-b173-ed46be742293 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:28.010505 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-193d683a-0db9-477b-b173-ed46be742293 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:28.016113 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-193d683a-0db9-477b-b173-ed46be742293 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:28.016841 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-193d683a-0db9-477b-b173-ed46be742293 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:28.133230 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-9d015549-ee20-4038-96e1-1902c7f25fed tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:28.142913 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-9d015549-ee20-4038-96e1-1902c7f25fed tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:28.150404 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-9d015549-ee20-4038-96e1-1902c7f25fed tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:28.153039 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-9d015549-ee20-4038-96e1-1902c7f25fed tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1723 microversion: 2.20 time: 0.414348 May 30 12:06:28.153516 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 172/358] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:06:27 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1723 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 30 12:06:28.174998 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-ca3afb41-45a0-4e97-bc9d-687b4f212edb req-959563f0-c2f1-46df-b554-fac591a79004 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11600577-2336-4fdd-b0f0-78fbf42f8ea1", "name": "network-vif-plugged", "status": "completed", "tag": "de5378e4-4146-4fbc-9827-83be39fbf054"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:06:28.194203 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-ca3afb41-45a0-4e97-bc9d-687b4f212edb req-959563f0-c2f1-46df-b554-fac591a79004 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:28.195089 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-ca3afb41-45a0-4e97-bc9d-687b4f212edb req-959563f0-c2f1-46df-b554-fac591a79004 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:28.213531 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-ca3afb41-45a0-4e97-bc9d-687b4f212edb req-959563f0-c2f1-46df-b554-fac591a79004 service nova] Creating event network-vif-plugged:de5378e4-4146-4fbc-9827-83be39fbf054 for instance 11600577-2336-4fdd-b0f0-78fbf42f8ea1 on hv-cinder-84051 May 30 12:06:28.219618 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-ca3afb41-45a0-4e97-bc9d-687b4f212edb req-959563f0-c2f1-46df-b554-fac591a79004 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059850 May 30 12:06:28.220648 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 173/359] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:06:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:06:28.281492 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-17713570-04ef-4c81-9440-eaab7dc404b0 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:28.282501 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-17713570-04ef-4c81-9440-eaab7dc404b0 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] [instance: 11600577-2336-4fdd-b0f0-78fbf42f8ea1] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:28.294129 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-17713570-04ef-4c81-9440-eaab7dc404b0 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:28.294818 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-17713570-04ef-4c81-9440-eaab7dc404b0 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:28.295894 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-17713570-04ef-4c81-9440-eaab7dc404b0 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:28.297208 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-17713570-04ef-4c81-9440-eaab7dc404b0 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:28.303978 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-193d683a-0db9-477b-b173-ed46be742293 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76e8d7bfdc04ea79c83ca7fb6b9ade1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5074cf3e6248668995f266845c8969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:28.316182 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-193d683a-0db9-477b-b173-ed46be742293 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed" status: 200 len: 1723 microversion: 2.1 time: 0.333975 May 30 12:06:28.317333 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 187/360] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:27 2022] GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed => generated 1723 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:06:28.676892 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-17713570-04ef-4c81-9440-eaab7dc404b0 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4c83a1ccfc43beb3f48e4462b06794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cd1e0377594f52bb5bfa7159731d48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:28.704661 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-17713570-04ef-4c81-9440-eaab7dc404b0 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] 10.222.0.32 "GET /compute/v2.1/servers/11600577-2336-4fdd-b0f0-78fbf42f8ea1" status: 200 len: 1318 microversion: 2.1 time: 0.441939 May 30 12:06:28.705291 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 174/361] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:28 2022] GET /compute/v2.1/servers/11600577-2336-4fdd-b0f0-78fbf42f8ea1 => generated 1318 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:06:28.839361 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-2a13710f-c914-4a98-8fd7-5bf3d5239bcb tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:28.840803 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-2a13710f-c914-4a98-8fd7-5bf3d5239bcb tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 83f672fe-d699-4f70-bc26-74dced714a5d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:28.848817 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2a13710f-c914-4a98-8fd7-5bf3d5239bcb tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:28.849567 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2a13710f-c914-4a98-8fd7-5bf3d5239bcb tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:28.850582 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2a13710f-c914-4a98-8fd7-5bf3d5239bcb tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:28.851281 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2a13710f-c914-4a98-8fd7-5bf3d5239bcb tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:29.170933 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-c3a88879-2cf7-44f8-9f4b-737284074507 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:29.172644 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-c3a88879-2cf7-44f8-9f4b-737284074507 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:29.185497 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-2a13710f-c914-4a98-8fd7-5bf3d5239bcb tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:29.191853 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c3a88879-2cf7-44f8-9f4b-737284074507 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:29.193425 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c3a88879-2cf7-44f8-9f4b-737284074507 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:29.197076 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c3a88879-2cf7-44f8-9f4b-737284074507 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:29.198266 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c3a88879-2cf7-44f8-9f4b-737284074507 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:29.201753 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-2a13710f-c914-4a98-8fd7-5bf3d5239bcb tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d" status: 200 len: 1372 microversion: 2.1 time: 0.369096 May 30 12:06:29.203574 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 188/362] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:28 2022] GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d => generated 1372 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:06:29.239489 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:29.334823 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-1353c77f-d495-4ff8-a4d5-722d2e9a0cca tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:29.335433 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-1353c77f-d495-4ff8-a4d5-722d2e9a0cca tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 08b1b860-516e-4041-8df8-1fa8cc65a4ed] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:29.342031 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1353c77f-d495-4ff8-a4d5-722d2e9a0cca tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:29.342473 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1353c77f-d495-4ff8-a4d5-722d2e9a0cca tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:29.343489 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1353c77f-d495-4ff8-a4d5-722d2e9a0cca tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:29.344219 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1353c77f-d495-4ff8-a4d5-722d2e9a0cca tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:29.970362 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-1353c77f-d495-4ff8-a4d5-722d2e9a0cca tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76e8d7bfdc04ea79c83ca7fb6b9ade1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5074cf3e6248668995f266845c8969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:29.972855 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-c3a88879-2cf7-44f8-9f4b-737284074507 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:29.983008 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-c3a88879-2cf7-44f8-9f4b-737284074507 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:29.986169 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-c3a88879-2cf7-44f8-9f4b-737284074507 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:29.987383 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-1353c77f-d495-4ff8-a4d5-722d2e9a0cca tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed" status: 200 len: 1723 microversion: 2.1 time: 0.656402 May 30 12:06:29.987633 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-c3a88879-2cf7-44f8-9f4b-737284074507 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1723 microversion: 2.20 time: 0.820513 May 30 12:06:29.998792 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 189/363] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:29 2022] GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed => generated 1723 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:06:30.000591 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 175/364] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:06:29 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1723 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 30 12:06:30.004849 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-ce3da7ff-758f-4b3e-b1da-9b0aa0a6d2ee tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:30.005696 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-ce3da7ff-758f-4b3e-b1da-9b0aa0a6d2ee tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] [instance: 11600577-2336-4fdd-b0f0-78fbf42f8ea1] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:30.006485 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-1b12f854-72c8-44a2-aeeb-e5dc0ff59f5c req-761bc83f-bb87-431c-9598-119b61e1f1f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83f672fe-d699-4f70-bc26-74dced714a5d", "tag": "e405a0d8-23b0-474a-be51-1a5734d329c4"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:06:30.020222 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ce3da7ff-758f-4b3e-b1da-9b0aa0a6d2ee tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:30.021002 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ce3da7ff-758f-4b3e-b1da-9b0aa0a6d2ee tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:30.021274 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-1b12f854-72c8-44a2-aeeb-e5dc0ff59f5c req-761bc83f-bb87-431c-9598-119b61e1f1f5 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:30.022021 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-1b12f854-72c8-44a2-aeeb-e5dc0ff59f5c req-761bc83f-bb87-431c-9598-119b61e1f1f5 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:30.022352 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ce3da7ff-758f-4b3e-b1da-9b0aa0a6d2ee tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:30.022939 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ce3da7ff-758f-4b3e-b1da-9b0aa0a6d2ee tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:30.040031 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-1b12f854-72c8-44a2-aeeb-e5dc0ff59f5c req-761bc83f-bb87-431c-9598-119b61e1f1f5 service nova] Creating event network-changed:e405a0d8-23b0-474a-be51-1a5734d329c4 for instance 83f672fe-d699-4f70-bc26-74dced714a5d on hv-cinder-84051 May 30 12:06:30.045046 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell1:SELECT=100 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:30.045710 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-1b12f854-72c8-44a2-aeeb-e5dc0ff59f5c req-761bc83f-bb87-431c-9598-119b61e1f1f5 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043589 May 30 12:06:30.047102 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 176/365] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:06:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:06:30.221703 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-a20f5210-2215-4f3c-8a47-dc620d9ada58 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:30.224558 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-a20f5210-2215-4f3c-8a47-dc620d9ada58 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 83f672fe-d699-4f70-bc26-74dced714a5d] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:30.236183 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a20f5210-2215-4f3c-8a47-dc620d9ada58 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:30.237332 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a20f5210-2215-4f3c-8a47-dc620d9ada58 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:30.257587 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a20f5210-2215-4f3c-8a47-dc620d9ada58 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:30.259708 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a20f5210-2215-4f3c-8a47-dc620d9ada58 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:30.308003 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-ce3da7ff-758f-4b3e-b1da-9b0aa0a6d2ee tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4c83a1ccfc43beb3f48e4462b06794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cd1e0377594f52bb5bfa7159731d48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:30.317318 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-ce3da7ff-758f-4b3e-b1da-9b0aa0a6d2ee tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] 10.222.0.32 "GET /compute/v2.1/servers/11600577-2336-4fdd-b0f0-78fbf42f8ea1" status: 200 len: 1318 microversion: 2.1 time: 0.316936 May 30 12:06:30.341367 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 190/366] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:29 2022] GET /compute/v2.1/servers/11600577-2336-4fdd-b0f0-78fbf42f8ea1 => generated 1318 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:06:30.550155 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-a20f5210-2215-4f3c-8a47-dc620d9ada58 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:30.559671 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-a20f5210-2215-4f3c-8a47-dc620d9ada58 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d" status: 200 len: 1372 microversion: 2.1 time: 0.344327 May 30 12:06:30.561073 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 177/367] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:30 2022] GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d => generated 1372 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:06:30.619337 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-86c8fb2d-439e-437b-98ec-7768f086a1d0 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-799889219", "imageRef": "b8ef93ed-af98-4d8c-9e1d-43d7b1f2b832", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "910909fe-c0b0-4c8d-8e4c-a23ea4b0eddd"}], "security_groups": [{"name": "tempest-securitygroup--417406428"}], "key_name": "tempest-keypair-937841626", "user_data": "}} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:06:30.751031 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.network.neutron [None req-86c8fb2d-439e-437b-98ec-7768f086a1d0 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] validate_networks() for [('910909fe-c0b0-4c8d-8e4c-a23ea4b0eddd', None, None, None, None, None)] {{(pid=117671) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 30 12:06:31.005391 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-ab0eacca-a7f7-4f83-aa19-11c4a31436b3 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:31.006408 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-ab0eacca-a7f7-4f83-aa19-11c4a31436b3 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 08b1b860-516e-4041-8df8-1fa8cc65a4ed] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:31.018846 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ab0eacca-a7f7-4f83-aa19-11c4a31436b3 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:31.019400 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ab0eacca-a7f7-4f83-aa19-11c4a31436b3 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:31.020581 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ab0eacca-a7f7-4f83-aa19-11c4a31436b3 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:31.021093 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ab0eacca-a7f7-4f83-aa19-11c4a31436b3 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:31.251357 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-ab0eacca-a7f7-4f83-aa19-11c4a31436b3 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76e8d7bfdc04ea79c83ca7fb6b9ade1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5074cf3e6248668995f266845c8969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:31.262821 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-ab0eacca-a7f7-4f83-aa19-11c4a31436b3 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed" status: 200 len: 1700 microversion: 2.1 time: 0.261370 May 30 12:06:31.263948 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 178/368] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:31 2022] GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed => generated 1700 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:06:31.270860 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-ba9304cd-523a-4f37-a7e6-a9cc0fd1e5aa tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:31.271659 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-ba9304cd-523a-4f37-a7e6-a9cc0fd1e5aa tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:31.279616 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ba9304cd-523a-4f37-a7e6-a9cc0fd1e5aa tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:31.281267 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ba9304cd-523a-4f37-a7e6-a9cc0fd1e5aa tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:31.282987 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ba9304cd-523a-4f37-a7e6-a9cc0fd1e5aa tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:31.283617 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ba9304cd-523a-4f37-a7e6-a9cc0fd1e5aa tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:31.289321 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-86c8fb2d-439e-437b-98ec-7768f086a1d0 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Flavor limits 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 30 12:06:31.289866 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-86c8fb2d-439e-437b-98ec-7768f086a1d0 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Image limits 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 30 12:06:31.290479 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-86c8fb2d-439e-437b-98ec-7768f086a1d0 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Flavor pref 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 30 12:06:31.290992 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-86c8fb2d-439e-437b-98ec-7768f086a1d0 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Image pref 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 30 12:06:31.291475 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-86c8fb2d-439e-437b-98ec-7768f086a1d0 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 30 12:06:31.306462 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-86c8fb2d-439e-437b-98ec-7768f086a1d0 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:31.308812 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-86c8fb2d-439e-437b-98ec-7768f086a1d0 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:31.309869 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-86c8fb2d-439e-437b-98ec-7768f086a1d0 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:31.310392 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-86c8fb2d-439e-437b-98ec-7768f086a1d0 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:31.342247 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.quota [None req-86c8fb2d-439e-437b-98ec-7768f086a1d0 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Getting quotas for project 20763921c37c4e81bba702e09bf628b2. Resources: {'cores', 'instances', 'ram'} {{(pid=117671) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 30 12:06:31.349446 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.quota [None req-86c8fb2d-439e-437b-98ec-7768f086a1d0 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Getting quotas for user 7575179edbda45208561c983fc5b956c and project 20763921c37c4e81bba702e09bf628b2. Resources: {'cores', 'instances', 'ram'} {{(pid=117671) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 30 12:06:31.363772 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-86c8fb2d-439e-437b-98ec-7768f086a1d0 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Going to run 1 instances... {{(pid=117671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 30 12:06:31.366036 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-86c8fb2d-439e-437b-98ec-7768f086a1d0 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: 611aebbd-06cc-46a9-ba2f-a01decf8d94a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b8ef93ed-af98-4d8c-9e1d-43d7b1f2b832',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 30 12:06:31.448916 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-ba9304cd-523a-4f37-a7e6-a9cc0fd1e5aa tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:31.459159 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-ba9304cd-523a-4f37-a7e6-a9cc0fd1e5aa tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:31.461023 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-ba9304cd-523a-4f37-a7e6-a9cc0fd1e5aa tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:31.462240 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-ba9304cd-523a-4f37-a7e6-a9cc0fd1e5aa tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1744 microversion: 2.20 time: 0.197181 May 30 12:06:31.462806 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 179/369] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:06:31 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1744 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:06:31.466255 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-86c8fb2d-439e-437b-98ec-7768f086a1d0 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.851784 May 30 12:06:31.468099 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-efa0a670-225f-48aa-866d-9c0d5f9fb509 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:06:31.470664 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 191/370] 10.222.0.32 () {60 vars in 1146 bytes} [Mon May 30 12:06:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 857 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 30 12:06:31.475663 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-efa0a670-225f-48aa-866d-9c0d5f9fb509 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:31.481025 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-48bc8213-8130-4818-82ef-7d0f1ed65cfc tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:31.486999 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-48bc8213-8130-4818-82ef-7d0f1ed65cfc tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] [instance: 11600577-2336-4fdd-b0f0-78fbf42f8ea1] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:31.491388 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-efa0a670-225f-48aa-866d-9c0d5f9fb509 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:31.498348 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-48bc8213-8130-4818-82ef-7d0f1ed65cfc tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:31.498948 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-48bc8213-8130-4818-82ef-7d0f1ed65cfc tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:31.501159 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-48bc8213-8130-4818-82ef-7d0f1ed65cfc tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:31.501881 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-48bc8213-8130-4818-82ef-7d0f1ed65cfc tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:31.627766 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-efa0a670-225f-48aa-866d-9c0d5f9fb509 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 08b1b860-516e-4041-8df8-1fa8cc65a4ed] Going to try to start instance {{(pid=117670) start /opt/stack/nova/nova/compute/api.py:2730}} May 30 12:06:31.704376 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-efa0a670-225f-48aa-866d-9c0d5f9fb509 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "POST /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed/action" status: 202 len: 0 microversion: 2.1 time: 0.239897 May 30 12:06:31.704958 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 180/371] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 30 12:06:31 2022] POST /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 30 12:06:31.712874 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-48bc8213-8130-4818-82ef-7d0f1ed65cfc tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4c83a1ccfc43beb3f48e4462b06794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cd1e0377594f52bb5bfa7159731d48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:31.716545 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-65b0c60f-c400-48fa-99d2-7ed0b38443f1 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:31.717396 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-65b0c60f-c400-48fa-99d2-7ed0b38443f1 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: 611aebbd-06cc-46a9-ba2f-a01decf8d94a] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:31.721684 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-48bc8213-8130-4818-82ef-7d0f1ed65cfc tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] 10.222.0.32 "GET /compute/v2.1/servers/11600577-2336-4fdd-b0f0-78fbf42f8ea1" status: 200 len: 1507 microversion: 2.1 time: 0.244418 May 30 12:06:31.722073 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 192/372] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:31 2022] GET /compute/v2.1/servers/11600577-2336-4fdd-b0f0-78fbf42f8ea1 => generated 1507 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:06:31.727235 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-53ad04b6-4b66-4279-8ff2-2adf0fbb8131 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:31.727846 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-53ad04b6-4b66-4279-8ff2-2adf0fbb8131 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 83f672fe-d699-4f70-bc26-74dced714a5d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:31.735886 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-53ad04b6-4b66-4279-8ff2-2adf0fbb8131 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:31.736369 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-53ad04b6-4b66-4279-8ff2-2adf0fbb8131 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:31.737139 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-53ad04b6-4b66-4279-8ff2-2adf0fbb8131 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:31.737568 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-53ad04b6-4b66-4279-8ff2-2adf0fbb8131 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:31.796866 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-65b0c60f-c400-48fa-99d2-7ed0b38443f1 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7575179edbda45208561c983fc5b956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20763921c37c4e81bba702e09bf628b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:31.805240 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-65b0c60f-c400-48fa-99d2-7ed0b38443f1 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/611aebbd-06cc-46a9-ba2f-a01decf8d94a" status: 200 len: 1240 microversion: 2.1 time: 0.096000 May 30 12:06:31.818173 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 181/373] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:31 2022] GET /compute/v2.1/servers/611aebbd-06cc-46a9-ba2f-a01decf8d94a => generated 1240 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:06:31.818173 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-faaf004b-39a2-426e-94ce-10208a9446ef tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:31.818173 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-faaf004b-39a2-426e-94ce-10208a9446ef tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 08b1b860-516e-4041-8df8-1fa8cc65a4ed] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:31.833352 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-faaf004b-39a2-426e-94ce-10208a9446ef tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:31.839945 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-faaf004b-39a2-426e-94ce-10208a9446ef tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:31.841005 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-faaf004b-39a2-426e-94ce-10208a9446ef tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:31.841454 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-faaf004b-39a2-426e-94ce-10208a9446ef tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:32.118928 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-53ad04b6-4b66-4279-8ff2-2adf0fbb8131 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:32.127131 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-53ad04b6-4b66-4279-8ff2-2adf0fbb8131 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d" status: 200 len: 1372 microversion: 2.1 time: 0.404024 May 30 12:06:32.127706 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 193/374] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:31 2022] GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d => generated 1372 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:06:32.176858 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-faaf004b-39a2-426e-94ce-10208a9446ef tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76e8d7bfdc04ea79c83ca7fb6b9ade1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5074cf3e6248668995f266845c8969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:32.187910 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-faaf004b-39a2-426e-94ce-10208a9446ef tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed" status: 200 len: 1709 microversion: 2.1 time: 0.378844 May 30 12:06:32.188898 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 182/375] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:31 2022] GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed => generated 1709 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:06:32.481648 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-20b2a31b-5e08-4aee-891e-0290eb1dd03e tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:32.482329 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-20b2a31b-5e08-4aee-891e-0290eb1dd03e tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:32.488897 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-20b2a31b-5e08-4aee-891e-0290eb1dd03e tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:32.489590 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-20b2a31b-5e08-4aee-891e-0290eb1dd03e tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:32.490458 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-20b2a31b-5e08-4aee-891e-0290eb1dd03e tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:32.490894 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-20b2a31b-5e08-4aee-891e-0290eb1dd03e tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:32.712535 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-20b2a31b-5e08-4aee-891e-0290eb1dd03e tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:32.725978 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-20b2a31b-5e08-4aee-891e-0290eb1dd03e tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:32.729840 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-20b2a31b-5e08-4aee-891e-0290eb1dd03e tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:32.733278 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-20b2a31b-5e08-4aee-891e-0290eb1dd03e tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1744 microversion: 2.20 time: 0.253522 May 30 12:06:32.736185 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 194/376] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:06:32 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1744 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:06:32.838124 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-3af449e9-8f05-4fc7-b223-5fafd460ccd4 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:32.841890 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-3af449e9-8f05-4fc7-b223-5fafd460ccd4 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: 611aebbd-06cc-46a9-ba2f-a01decf8d94a] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:32.862609 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3af449e9-8f05-4fc7-b223-5fafd460ccd4 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:32.863078 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3af449e9-8f05-4fc7-b223-5fafd460ccd4 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:32.871720 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3af449e9-8f05-4fc7-b223-5fafd460ccd4 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:32.871720 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3af449e9-8f05-4fc7-b223-5fafd460ccd4 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:33.019770 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-3af449e9-8f05-4fc7-b223-5fafd460ccd4 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7575179edbda45208561c983fc5b956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20763921c37c4e81bba702e09bf628b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:33.027961 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-3af449e9-8f05-4fc7-b223-5fafd460ccd4 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/611aebbd-06cc-46a9-ba2f-a01decf8d94a" status: 200 len: 1236 microversion: 2.1 time: 0.204194 May 30 12:06:33.039508 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 183/377] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:32 2022] GET /compute/v2.1/servers/611aebbd-06cc-46a9-ba2f-a01decf8d94a => generated 1236 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:06:33.143404 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-2302aac7-d95d-4c8e-b2f9-568e6d7ee2be tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:33.144024 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-2302aac7-d95d-4c8e-b2f9-568e6d7ee2be tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 83f672fe-d699-4f70-bc26-74dced714a5d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:33.151820 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2302aac7-d95d-4c8e-b2f9-568e6d7ee2be tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:33.152314 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2302aac7-d95d-4c8e-b2f9-568e6d7ee2be tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:33.153137 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2302aac7-d95d-4c8e-b2f9-568e6d7ee2be tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:33.153598 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2302aac7-d95d-4c8e-b2f9-568e6d7ee2be tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:33.208097 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-de185c53-d304-47c1-ad92-be27a2ebbbf7 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:33.209243 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-de185c53-d304-47c1-ad92-be27a2ebbbf7 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 08b1b860-516e-4041-8df8-1fa8cc65a4ed] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:33.223096 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-de185c53-d304-47c1-ad92-be27a2ebbbf7 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:33.223687 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-de185c53-d304-47c1-ad92-be27a2ebbbf7 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:33.228839 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-de185c53-d304-47c1-ad92-be27a2ebbbf7 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:33.229496 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-de185c53-d304-47c1-ad92-be27a2ebbbf7 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:33.496439 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-2302aac7-d95d-4c8e-b2f9-568e6d7ee2be tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:33.519839 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-2302aac7-d95d-4c8e-b2f9-568e6d7ee2be tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d" status: 200 len: 1372 microversion: 2.1 time: 0.380525 May 30 12:06:33.522343 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 195/378] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:33 2022] GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d => generated 1372 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:06:33.532401 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-de185c53-d304-47c1-ad92-be27a2ebbbf7 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76e8d7bfdc04ea79c83ca7fb6b9ade1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5074cf3e6248668995f266845c8969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:33.543002 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-de185c53-d304-47c1-ad92-be27a2ebbbf7 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed" status: 200 len: 1709 microversion: 2.1 time: 0.340442 May 30 12:06:33.548494 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 184/379] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:33 2022] GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed => generated 1709 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:06:33.753647 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-3a8b868a-32f8-4885-a27e-46c40d6e4355 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:33.754257 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-3a8b868a-32f8-4885-a27e-46c40d6e4355 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:33.761769 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3a8b868a-32f8-4885-a27e-46c40d6e4355 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:33.762348 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3a8b868a-32f8-4885-a27e-46c40d6e4355 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:33.768040 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3a8b868a-32f8-4885-a27e-46c40d6e4355 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:33.770442 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3a8b868a-32f8-4885-a27e-46c40d6e4355 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:33.993876 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-3a8b868a-32f8-4885-a27e-46c40d6e4355 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:34.009023 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-3a8b868a-32f8-4885-a27e-46c40d6e4355 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:34.012060 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-3a8b868a-32f8-4885-a27e-46c40d6e4355 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:34.013631 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-3a8b868a-32f8-4885-a27e-46c40d6e4355 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1744 microversion: 2.20 time: 0.264497 May 30 12:06:34.014432 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 196/380] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:06:33 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1744 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:06:34.048250 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-8d3b86d9-91f4-47c7-bfcd-74dec77dd30e tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:34.049737 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-8d3b86d9-91f4-47c7-bfcd-74dec77dd30e tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: 611aebbd-06cc-46a9-ba2f-a01decf8d94a] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:34.064004 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8d3b86d9-91f4-47c7-bfcd-74dec77dd30e tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:34.064849 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8d3b86d9-91f4-47c7-bfcd-74dec77dd30e tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:34.068583 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8d3b86d9-91f4-47c7-bfcd-74dec77dd30e tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:34.073198 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8d3b86d9-91f4-47c7-bfcd-74dec77dd30e tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:34.218319 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-8d3b86d9-91f4-47c7-bfcd-74dec77dd30e tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7575179edbda45208561c983fc5b956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20763921c37c4e81bba702e09bf628b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:34.228452 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-8d3b86d9-91f4-47c7-bfcd-74dec77dd30e tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/611aebbd-06cc-46a9-ba2f-a01decf8d94a" status: 200 len: 1298 microversion: 2.1 time: 0.185755 May 30 12:06:34.235724 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 185/381] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:34 2022] GET /compute/v2.1/servers/611aebbd-06cc-46a9-ba2f-a01decf8d94a => generated 1298 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:06:34.538685 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-efe82806-435b-49d7-aa1b-4eebd3823fba tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:34.539295 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-efe82806-435b-49d7-aa1b-4eebd3823fba tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 83f672fe-d699-4f70-bc26-74dced714a5d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:34.546128 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-efe82806-435b-49d7-aa1b-4eebd3823fba tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:34.547188 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-efe82806-435b-49d7-aa1b-4eebd3823fba tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:34.548415 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-efe82806-435b-49d7-aa1b-4eebd3823fba tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:34.549070 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-efe82806-435b-49d7-aa1b-4eebd3823fba tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:34.561402 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-cb7bf376-13b5-452c-afaa-0b84905be217 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:34.563264 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-cb7bf376-13b5-452c-afaa-0b84905be217 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 08b1b860-516e-4041-8df8-1fa8cc65a4ed] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:34.586430 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-cb7bf376-13b5-452c-afaa-0b84905be217 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:34.597234 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-cb7bf376-13b5-452c-afaa-0b84905be217 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:34.600843 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-cb7bf376-13b5-452c-afaa-0b84905be217 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:34.601404 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-cb7bf376-13b5-452c-afaa-0b84905be217 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:34.905729 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-efe82806-435b-49d7-aa1b-4eebd3823fba tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:34.916387 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-efe82806-435b-49d7-aa1b-4eebd3823fba tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d" status: 200 len: 1372 microversion: 2.1 time: 0.381376 May 30 12:06:34.922846 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 197/382] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:34 2022] GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d => generated 1372 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:06:34.936284 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-cb7bf376-13b5-452c-afaa-0b84905be217 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76e8d7bfdc04ea79c83ca7fb6b9ade1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5074cf3e6248668995f266845c8969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:34.949342 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-cb7bf376-13b5-452c-afaa-0b84905be217 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed" status: 200 len: 1709 microversion: 2.1 time: 0.391834 May 30 12:06:34.950275 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 186/383] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:34 2022] GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed => generated 1709 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:06:35.033195 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-703f048e-923d-47d7-8f66-f47fa441a8fb tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:35.034499 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-703f048e-923d-47d7-8f66-f47fa441a8fb tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:35.043070 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-703f048e-923d-47d7-8f66-f47fa441a8fb tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:35.043853 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-703f048e-923d-47d7-8f66-f47fa441a8fb tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:35.045048 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-703f048e-923d-47d7-8f66-f47fa441a8fb tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:35.045692 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-703f048e-923d-47d7-8f66-f47fa441a8fb tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:35.250032 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-703f048e-923d-47d7-8f66-f47fa441a8fb tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:35.263299 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-4a94c13f-dc5d-4ec1-b9cc-0c1b412e2b18 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:35.265116 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-4a94c13f-dc5d-4ec1-b9cc-0c1b412e2b18 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: 611aebbd-06cc-46a9-ba2f-a01decf8d94a] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:35.280719 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-703f048e-923d-47d7-8f66-f47fa441a8fb tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:35.283531 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4a94c13f-dc5d-4ec1-b9cc-0c1b412e2b18 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:35.285175 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4a94c13f-dc5d-4ec1-b9cc-0c1b412e2b18 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:35.286044 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-703f048e-923d-47d7-8f66-f47fa441a8fb tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:35.287418 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4a94c13f-dc5d-4ec1-b9cc-0c1b412e2b18 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:35.289139 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-703f048e-923d-47d7-8f66-f47fa441a8fb tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1739 microversion: 2.20 time: 0.260687 May 30 12:06:35.289879 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4a94c13f-dc5d-4ec1-b9cc-0c1b412e2b18 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:35.305092 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 198/384] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:06:35 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1739 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:06:35.584137 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-4a94c13f-dc5d-4ec1-b9cc-0c1b412e2b18 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7575179edbda45208561c983fc5b956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20763921c37c4e81bba702e09bf628b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:35.604052 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-4a94c13f-dc5d-4ec1-b9cc-0c1b412e2b18 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/611aebbd-06cc-46a9-ba2f-a01decf8d94a" status: 200 len: 1365 microversion: 2.1 time: 0.352184 May 30 12:06:35.605099 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 187/385] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:35 2022] GET /compute/v2.1/servers/611aebbd-06cc-46a9-ba2f-a01decf8d94a => generated 1365 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:06:35.942935 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-18bb35da-39c5-4520-9f26-81888f8ede86 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:35.944621 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-18bb35da-39c5-4520-9f26-81888f8ede86 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 83f672fe-d699-4f70-bc26-74dced714a5d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:35.957194 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-18bb35da-39c5-4520-9f26-81888f8ede86 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:35.978111 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-3f860d6a-e670-401e-a742-a1127f6baf0e tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:35.979335 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-3f860d6a-e670-401e-a742-a1127f6baf0e tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 08b1b860-516e-4041-8df8-1fa8cc65a4ed] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:35.990416 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-18bb35da-39c5-4520-9f26-81888f8ede86 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.033s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:35.992355 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-18bb35da-39c5-4520-9f26-81888f8ede86 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:35.997606 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-18bb35da-39c5-4520-9f26-81888f8ede86 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:36.001600 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3f860d6a-e670-401e-a742-a1127f6baf0e tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:36.020794 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3f860d6a-e670-401e-a742-a1127f6baf0e tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:36.027668 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3f860d6a-e670-401e-a742-a1127f6baf0e tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:36.028321 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3f860d6a-e670-401e-a742-a1127f6baf0e tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:36.534447 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-3f860d6a-e670-401e-a742-a1127f6baf0e tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76e8d7bfdc04ea79c83ca7fb6b9ade1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5074cf3e6248668995f266845c8969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:36.559803 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-3f860d6a-e670-401e-a742-a1127f6baf0e tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed" status: 200 len: 1713 microversion: 2.1 time: 0.595249 May 30 12:06:36.566025 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 188/386] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:35 2022] GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed => generated 1713 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:06:36.567553 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-18bb35da-39c5-4520-9f26-81888f8ede86 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:36.583496 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-18bb35da-39c5-4520-9f26-81888f8ede86 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d" status: 200 len: 1372 microversion: 2.1 time: 0.644645 May 30 12:06:36.584251 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 199/387] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:35 2022] GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d => generated 1372 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:06:36.599029 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-f0f5560a-96c2-4cf9-bad0-3dc7c46fc563 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:36.599748 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-8d4101af-1bda-46eb-beba-8a239612d63c req-a3c662bc-12ff-4c22-b69b-943839f4a2fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "611aebbd-06cc-46a9-ba2f-a01decf8d94a", "tag": "8206cdb6-1ac2-439c-8225-5f66c1635ad9"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:06:36.599904 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-f0f5560a-96c2-4cf9-bad0-3dc7c46fc563 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:36.610258 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-8d4101af-1bda-46eb-beba-8a239612d63c req-a3c662bc-12ff-4c22-b69b-943839f4a2fc service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:36.610997 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-8d4101af-1bda-46eb-beba-8a239612d63c req-a3c662bc-12ff-4c22-b69b-943839f4a2fc service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:36.623361 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f0f5560a-96c2-4cf9-bad0-3dc7c46fc563 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:36.624742 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f0f5560a-96c2-4cf9-bad0-3dc7c46fc563 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:36.630672 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f0f5560a-96c2-4cf9-bad0-3dc7c46fc563 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:36.631461 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f0f5560a-96c2-4cf9-bad0-3dc7c46fc563 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:36.642803 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-8d4101af-1bda-46eb-beba-8a239612d63c req-a3c662bc-12ff-4c22-b69b-943839f4a2fc service nova] Creating event network-changed:8206cdb6-1ac2-439c-8225-5f66c1635ad9 for instance 611aebbd-06cc-46a9-ba2f-a01decf8d94a on hv-cinder-84051 May 30 12:06:36.658281 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-8d4101af-1bda-46eb-beba-8a239612d63c req-a3c662bc-12ff-4c22-b69b-943839f4a2fc service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062004 May 30 12:06:36.659348 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 200/388] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:06:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:06:36.664706 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-09e81dec-be5c-4e93-9c30-7b01430dbc4a req-5e43d182-c05a-4860-a66a-1e05c68ed924 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "314658c0-2ad4-4987-99bc-f8acf2d7e46c", "name": "network-vif-plugged", "status": "completed", "tag": "66de87a6-f3b1-41fb-8926-85240efcbe51"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:06:36.695412 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-09e81dec-be5c-4e93-9c30-7b01430dbc4a req-5e43d182-c05a-4860-a66a-1e05c68ed924 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:36.696074 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-09e81dec-be5c-4e93-9c30-7b01430dbc4a req-5e43d182-c05a-4860-a66a-1e05c68ed924 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:36.732187 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-09e81dec-be5c-4e93-9c30-7b01430dbc4a req-5e43d182-c05a-4860-a66a-1e05c68ed924 service nova] Creating event network-vif-plugged:66de87a6-f3b1-41fb-8926-85240efcbe51 for instance 314658c0-2ad4-4987-99bc-f8acf2d7e46c on hv-cinder-84051 May 30 12:06:36.742839 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-09e81dec-be5c-4e93-9c30-7b01430dbc4a req-5e43d182-c05a-4860-a66a-1e05c68ed924 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078625 May 30 12:06:36.746045 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 201/389] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:06:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:06:36.757383 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-d95049b8-eb80-4ec9-9e69-b17a56b5d92a tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:36.758317 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-d95049b8-eb80-4ec9-9e69-b17a56b5d92a tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: 611aebbd-06cc-46a9-ba2f-a01decf8d94a] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:36.790284 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d95049b8-eb80-4ec9-9e69-b17a56b5d92a tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:36.793698 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d95049b8-eb80-4ec9-9e69-b17a56b5d92a tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:36.797751 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d95049b8-eb80-4ec9-9e69-b17a56b5d92a tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:36.802046 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d95049b8-eb80-4ec9-9e69-b17a56b5d92a tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:36.910534 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-f0f5560a-96c2-4cf9-bad0-3dc7c46fc563 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:36.922943 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-f0f5560a-96c2-4cf9-bad0-3dc7c46fc563 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:36.924616 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-f0f5560a-96c2-4cf9-bad0-3dc7c46fc563 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:36.925843 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-f0f5560a-96c2-4cf9-bad0-3dc7c46fc563 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1739 microversion: 2.20 time: 0.337848 May 30 12:06:36.932238 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 189/390] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:06:36 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1739 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:06:37.074536 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-d95049b8-eb80-4ec9-9e69-b17a56b5d92a tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7575179edbda45208561c983fc5b956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20763921c37c4e81bba702e09bf628b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:37.089897 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-d95049b8-eb80-4ec9-9e69-b17a56b5d92a tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/611aebbd-06cc-46a9-ba2f-a01decf8d94a" status: 200 len: 1365 microversion: 2.1 time: 0.342463 May 30 12:06:37.091078 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 202/391] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:36 2022] GET /compute/v2.1/servers/611aebbd-06cc-46a9-ba2f-a01decf8d94a => generated 1365 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:06:37.601987 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-81c291fa-4e28-4ba7-b7a4-7097f2724018 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:37.602594 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-81c291fa-4e28-4ba7-b7a4-7097f2724018 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 83f672fe-d699-4f70-bc26-74dced714a5d] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:37.612241 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-81c291fa-4e28-4ba7-b7a4-7097f2724018 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:37.612857 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-81c291fa-4e28-4ba7-b7a4-7097f2724018 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:37.613740 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-81c291fa-4e28-4ba7-b7a4-7097f2724018 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:37.614285 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-81c291fa-4e28-4ba7-b7a4-7097f2724018 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:37.769131 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-81c291fa-4e28-4ba7-b7a4-7097f2724018 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:37.776944 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-81c291fa-4e28-4ba7-b7a4-7097f2724018 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d" status: 200 len: 1372 microversion: 2.1 time: 0.179825 May 30 12:06:37.777507 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 190/392] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:37 2022] GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d => generated 1372 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:06:37.944129 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-0d29e450-489b-4cc0-a639-e4e1b9553dfc tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:37.944827 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-0d29e450-489b-4cc0-a639-e4e1b9553dfc tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:37.951139 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0d29e450-489b-4cc0-a639-e4e1b9553dfc tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:37.951707 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0d29e450-489b-4cc0-a639-e4e1b9553dfc tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:37.953446 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0d29e450-489b-4cc0-a639-e4e1b9553dfc tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:37.954065 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0d29e450-489b-4cc0-a639-e4e1b9553dfc tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:38.106857 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-207532ea-e8fd-48de-ad48-a9eba73e204a tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:38.107861 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-207532ea-e8fd-48de-ad48-a9eba73e204a tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: 611aebbd-06cc-46a9-ba2f-a01decf8d94a] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:38.114965 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-207532ea-e8fd-48de-ad48-a9eba73e204a tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:38.115569 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-207532ea-e8fd-48de-ad48-a9eba73e204a tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:38.116635 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-207532ea-e8fd-48de-ad48-a9eba73e204a tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:38.117392 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-207532ea-e8fd-48de-ad48-a9eba73e204a tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:38.125411 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-0d29e450-489b-4cc0-a639-e4e1b9553dfc tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:38.134251 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-0d29e450-489b-4cc0-a639-e4e1b9553dfc tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:38.136023 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-0d29e450-489b-4cc0-a639-e4e1b9553dfc tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:38.137647 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-0d29e450-489b-4cc0-a639-e4e1b9553dfc tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1739 microversion: 2.20 time: 0.197101 May 30 12:06:38.139159 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 203/393] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:06:37 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1739 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:06:38.290794 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-207532ea-e8fd-48de-ad48-a9eba73e204a tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7575179edbda45208561c983fc5b956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20763921c37c4e81bba702e09bf628b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:38.306628 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-207532ea-e8fd-48de-ad48-a9eba73e204a tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/611aebbd-06cc-46a9-ba2f-a01decf8d94a" status: 200 len: 1365 microversion: 2.1 time: 0.203449 May 30 12:06:38.319502 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 191/394] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:38 2022] GET /compute/v2.1/servers/611aebbd-06cc-46a9-ba2f-a01decf8d94a => generated 1365 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:06:38.767437 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-30995000-b6e3-47b8-ac88-603c81a0e3dc req-af690bbc-733d-4bd4-8c71-0d4e14aac791 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83f672fe-d699-4f70-bc26-74dced714a5d", "name": "network-vif-plugged", "status": "completed", "tag": "e405a0d8-23b0-474a-be51-1a5734d329c4"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:06:38.796857 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-ff87b79b-7e2c-4735-a4e6-cbf1b9350eeb tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:38.797583 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-ff87b79b-7e2c-4735-a4e6-cbf1b9350eeb tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 83f672fe-d699-4f70-bc26-74dced714a5d] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:38.805687 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-30995000-b6e3-47b8-ac88-603c81a0e3dc req-af690bbc-733d-4bd4-8c71-0d4e14aac791 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:38.807062 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ff87b79b-7e2c-4735-a4e6-cbf1b9350eeb tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:38.807062 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ff87b79b-7e2c-4735-a4e6-cbf1b9350eeb tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:38.807720 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ff87b79b-7e2c-4735-a4e6-cbf1b9350eeb tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:38.809107 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-30995000-b6e3-47b8-ac88-603c81a0e3dc req-af690bbc-733d-4bd4-8c71-0d4e14aac791 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:38.813932 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ff87b79b-7e2c-4735-a4e6-cbf1b9350eeb tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:38.827182 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-30995000-b6e3-47b8-ac88-603c81a0e3dc req-af690bbc-733d-4bd4-8c71-0d4e14aac791 service nova] Creating event network-vif-plugged:e405a0d8-23b0-474a-be51-1a5734d329c4 for instance 83f672fe-d699-4f70-bc26-74dced714a5d on hv-cinder-84051 May 30 12:06:38.836805 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-30995000-b6e3-47b8-ac88-603c81a0e3dc req-af690bbc-733d-4bd4-8c71-0d4e14aac791 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073574 May 30 12:06:38.841755 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:38.853641 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 204/395] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:06:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 30 12:06:38.992301 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-ff87b79b-7e2c-4735-a4e6-cbf1b9350eeb tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:39.000525 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-ff87b79b-7e2c-4735-a4e6-cbf1b9350eeb tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d" status: 200 len: 1372 microversion: 2.1 time: 0.208464 May 30 12:06:39.001395 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 192/396] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:38 2022] GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d => generated 1372 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:06:39.161711 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-f48605db-ec50-4e32-b01a-e910a9abefcb tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:39.162622 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-f48605db-ec50-4e32-b01a-e910a9abefcb tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:39.183813 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f48605db-ec50-4e32-b01a-e910a9abefcb tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:39.184523 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f48605db-ec50-4e32-b01a-e910a9abefcb tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:39.185412 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f48605db-ec50-4e32-b01a-e910a9abefcb tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:39.185797 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f48605db-ec50-4e32-b01a-e910a9abefcb tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:39.326105 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-244c3968-06b0-4218-9fc4-327a62d609ec tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:39.326744 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-244c3968-06b0-4218-9fc4-327a62d609ec tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: 611aebbd-06cc-46a9-ba2f-a01decf8d94a] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:39.334011 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-244c3968-06b0-4218-9fc4-327a62d609ec tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:39.334753 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-244c3968-06b0-4218-9fc4-327a62d609ec tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:39.335725 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-244c3968-06b0-4218-9fc4-327a62d609ec tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:39.336347 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-244c3968-06b0-4218-9fc4-327a62d609ec tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:39.375544 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-f48605db-ec50-4e32-b01a-e910a9abefcb tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:39.387798 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-f48605db-ec50-4e32-b01a-e910a9abefcb tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:39.390274 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-f48605db-ec50-4e32-b01a-e910a9abefcb tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:39.391710 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-f48605db-ec50-4e32-b01a-e910a9abefcb tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1739 microversion: 2.20 time: 0.236517 May 30 12:06:39.392531 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 205/397] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:06:39 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1739 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:06:39.487424 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-244c3968-06b0-4218-9fc4-327a62d609ec tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7575179edbda45208561c983fc5b956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20763921c37c4e81bba702e09bf628b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:39.495570 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-244c3968-06b0-4218-9fc4-327a62d609ec tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/611aebbd-06cc-46a9-ba2f-a01decf8d94a" status: 200 len: 1365 microversion: 2.1 time: 0.173431 May 30 12:06:39.496147 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 193/398] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:39 2022] GET /compute/v2.1/servers/611aebbd-06cc-46a9-ba2f-a01decf8d94a => generated 1365 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:06:40.017945 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-7a1cd6c6-0b64-47a4-a66b-317ac0dd8a23 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:40.018615 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-7a1cd6c6-0b64-47a4-a66b-317ac0dd8a23 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 83f672fe-d699-4f70-bc26-74dced714a5d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:40.026866 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7a1cd6c6-0b64-47a4-a66b-317ac0dd8a23 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:40.027557 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7a1cd6c6-0b64-47a4-a66b-317ac0dd8a23 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:40.028580 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7a1cd6c6-0b64-47a4-a66b-317ac0dd8a23 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:40.029018 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7a1cd6c6-0b64-47a4-a66b-317ac0dd8a23 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:40.206022 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-7a1cd6c6-0b64-47a4-a66b-317ac0dd8a23 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:40.216529 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-7a1cd6c6-0b64-47a4-a66b-317ac0dd8a23 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d" status: 200 len: 1372 microversion: 2.1 time: 0.202546 May 30 12:06:40.217258 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 206/399] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:40 2022] GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d => generated 1372 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:06:40.414240 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-98ea0b27-36dd-48d1-af14-6bc4c5dc34fa tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:40.415443 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-98ea0b27-36dd-48d1-af14-6bc4c5dc34fa tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:40.422487 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-98ea0b27-36dd-48d1-af14-6bc4c5dc34fa tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:40.423199 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-98ea0b27-36dd-48d1-af14-6bc4c5dc34fa tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:40.424001 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-98ea0b27-36dd-48d1-af14-6bc4c5dc34fa tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:40.424527 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-98ea0b27-36dd-48d1-af14-6bc4c5dc34fa tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:40.512747 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-ae54a4f5-1930-419b-bd50-05e504b92f4c tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:40.513660 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-ae54a4f5-1930-419b-bd50-05e504b92f4c tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: 611aebbd-06cc-46a9-ba2f-a01decf8d94a] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:40.516740 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:40.527404 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ae54a4f5-1930-419b-bd50-05e504b92f4c tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:40.528815 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ae54a4f5-1930-419b-bd50-05e504b92f4c tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:40.529864 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ae54a4f5-1930-419b-bd50-05e504b92f4c tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:40.530998 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ae54a4f5-1930-419b-bd50-05e504b92f4c tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:40.680733 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-98ea0b27-36dd-48d1-af14-6bc4c5dc34fa tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:40.740524 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-98ea0b27-36dd-48d1-af14-6bc4c5dc34fa tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:40.742505 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-98ea0b27-36dd-48d1-af14-6bc4c5dc34fa tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:40.752146 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-98ea0b27-36dd-48d1-af14-6bc4c5dc34fa tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1739 microversion: 2.20 time: 0.344931 May 30 12:06:40.766841 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 194/400] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:06:40 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1739 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:06:40.814663 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-ae54a4f5-1930-419b-bd50-05e504b92f4c tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7575179edbda45208561c983fc5b956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20763921c37c4e81bba702e09bf628b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:40.824515 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-ae54a4f5-1930-419b-bd50-05e504b92f4c tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/611aebbd-06cc-46a9-ba2f-a01decf8d94a" status: 200 len: 1365 microversion: 2.1 time: 0.315669 May 30 12:06:40.825404 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 207/401] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:40 2022] GET /compute/v2.1/servers/611aebbd-06cc-46a9-ba2f-a01decf8d94a => generated 1365 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:06:41.234495 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-259ea7c3-4417-4e9c-a84c-0e260fb4102b tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:41.236001 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-259ea7c3-4417-4e9c-a84c-0e260fb4102b tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 83f672fe-d699-4f70-bc26-74dced714a5d] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:41.244104 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-259ea7c3-4417-4e9c-a84c-0e260fb4102b tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:41.244853 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-259ea7c3-4417-4e9c-a84c-0e260fb4102b tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:41.245642 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-259ea7c3-4417-4e9c-a84c-0e260fb4102b tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:41.246076 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-259ea7c3-4417-4e9c-a84c-0e260fb4102b tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:41.403167 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-259ea7c3-4417-4e9c-a84c-0e260fb4102b tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:41.412299 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-259ea7c3-4417-4e9c-a84c-0e260fb4102b tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d" status: 200 len: 1372 microversion: 2.1 time: 0.181881 May 30 12:06:41.423068 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 195/402] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:41 2022] GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d => generated 1372 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:06:41.771729 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-0e7844f0-77c8-4aeb-a68f-bcf7e6c580cc tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:41.773017 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-0e7844f0-77c8-4aeb-a68f-bcf7e6c580cc tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:41.775691 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell0:SELECT=4 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:41.776963 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell0:SELECT=24 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:41.785552 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0e7844f0-77c8-4aeb-a68f-bcf7e6c580cc tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:41.786297 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0e7844f0-77c8-4aeb-a68f-bcf7e6c580cc tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:41.787236 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0e7844f0-77c8-4aeb-a68f-bcf7e6c580cc tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:41.787837 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0e7844f0-77c8-4aeb-a68f-bcf7e6c580cc tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:41.841128 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-27b76835-e829-4b6c-96e8-e437b887105f tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:41.846202 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-27b76835-e829-4b6c-96e8-e437b887105f tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: 611aebbd-06cc-46a9-ba2f-a01decf8d94a] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:41.848611 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell0:SELECT=2 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:41.855718 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-27b76835-e829-4b6c-96e8-e437b887105f tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:41.856190 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-27b76835-e829-4b6c-96e8-e437b887105f tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:41.857343 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-27b76835-e829-4b6c-96e8-e437b887105f tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:41.860615 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-27b76835-e829-4b6c-96e8-e437b887105f tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:41.994240 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-0e7844f0-77c8-4aeb-a68f-bcf7e6c580cc tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:42.015094 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-0e7844f0-77c8-4aeb-a68f-bcf7e6c580cc tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:42.018276 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-0e7844f0-77c8-4aeb-a68f-bcf7e6c580cc tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:42.020067 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-0e7844f0-77c8-4aeb-a68f-bcf7e6c580cc tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1739 microversion: 2.20 time: 0.252482 May 30 12:06:42.021173 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 208/403] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:06:41 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1739 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:06:42.098084 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-27b76835-e829-4b6c-96e8-e437b887105f tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7575179edbda45208561c983fc5b956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20763921c37c4e81bba702e09bf628b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:42.116340 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-27b76835-e829-4b6c-96e8-e437b887105f tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/611aebbd-06cc-46a9-ba2f-a01decf8d94a" status: 200 len: 1365 microversion: 2.1 time: 0.278936 May 30 12:06:42.126523 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 196/404] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:41 2022] GET /compute/v2.1/servers/611aebbd-06cc-46a9-ba2f-a01decf8d94a => generated 1365 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:06:42.430051 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-03ee1819-cecf-4d34-b2d2-039a3448c4a5 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:42.430637 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-03ee1819-cecf-4d34-b2d2-039a3448c4a5 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 83f672fe-d699-4f70-bc26-74dced714a5d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:42.437780 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-03ee1819-cecf-4d34-b2d2-039a3448c4a5 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:42.439435 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-03ee1819-cecf-4d34-b2d2-039a3448c4a5 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:42.442312 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-03ee1819-cecf-4d34-b2d2-039a3448c4a5 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:42.442312 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-03ee1819-cecf-4d34-b2d2-039a3448c4a5 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:42.604939 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-03ee1819-cecf-4d34-b2d2-039a3448c4a5 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:42.607287 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell1:SELECT=100 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:42.614758 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-03ee1819-cecf-4d34-b2d2-039a3448c4a5 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d" status: 200 len: 1566 microversion: 2.1 time: 0.188845 May 30 12:06:42.615668 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 209/405] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:42 2022] GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d => generated 1566 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:06:42.631167 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-6409afd0-fd93-4881-bfe6-e0a6f1da419a tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:42.631731 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-6409afd0-fd93-4881-bfe6-e0a6f1da419a tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 83f672fe-d699-4f70-bc26-74dced714a5d] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:42.638336 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6409afd0-fd93-4881-bfe6-e0a6f1da419a tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:42.638793 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6409afd0-fd93-4881-bfe6-e0a6f1da419a tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:42.639950 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6409afd0-fd93-4881-bfe6-e0a6f1da419a tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:42.640525 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6409afd0-fd93-4881-bfe6-e0a6f1da419a tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:42.732623 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-6409afd0-fd93-4881-bfe6-e0a6f1da419a tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.105267 May 30 12:06:42.734212 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 197/406] 10.222.0.32 () {58 vars in 1274 bytes} [Mon May 30 12:06:42 2022] GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d/os-interface => generated 284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:06:43.043344 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-fbe4bdbc-0a09-48f4-ab9d-80d8284792c6 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:43.044532 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-fbe4bdbc-0a09-48f4-ab9d-80d8284792c6 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:43.052655 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-fbe4bdbc-0a09-48f4-ab9d-80d8284792c6 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:43.053390 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-fbe4bdbc-0a09-48f4-ab9d-80d8284792c6 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:43.054442 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-fbe4bdbc-0a09-48f4-ab9d-80d8284792c6 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:43.054953 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-fbe4bdbc-0a09-48f4-ab9d-80d8284792c6 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:43.138802 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-e2eeba69-35b2-4621-bfc2-9a3a3a93a488 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:43.140146 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-e2eeba69-35b2-4621-bfc2-9a3a3a93a488 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: 611aebbd-06cc-46a9-ba2f-a01decf8d94a] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:43.164258 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e2eeba69-35b2-4621-bfc2-9a3a3a93a488 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:43.164960 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e2eeba69-35b2-4621-bfc2-9a3a3a93a488 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:43.165901 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e2eeba69-35b2-4621-bfc2-9a3a3a93a488 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:43.167987 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e2eeba69-35b2-4621-bfc2-9a3a3a93a488 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:43.469587 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-fbe4bdbc-0a09-48f4-ab9d-80d8284792c6 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:43.487529 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-fbe4bdbc-0a09-48f4-ab9d-80d8284792c6 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:43.489514 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-fbe4bdbc-0a09-48f4-ab9d-80d8284792c6 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:43.491030 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-fbe4bdbc-0a09-48f4-ab9d-80d8284792c6 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1739 microversion: 2.20 time: 0.452525 May 30 12:06:43.492083 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 210/407] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:06:43 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1739 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:06:43.594485 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-e2eeba69-35b2-4621-bfc2-9a3a3a93a488 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7575179edbda45208561c983fc5b956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20763921c37c4e81bba702e09bf628b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:43.602671 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-e2eeba69-35b2-4621-bfc2-9a3a3a93a488 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/611aebbd-06cc-46a9-ba2f-a01decf8d94a" status: 200 len: 1365 microversion: 2.1 time: 0.471700 May 30 12:06:43.612725 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 198/408] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:43 2022] GET /compute/v2.1/servers/611aebbd-06cc-46a9-ba2f-a01decf8d94a => generated 1365 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:06:44.265782 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-ecdd1856-a409-42b8-a324-a06e354a2334 req-48c618bd-f831-486d-a9da-2f769ece5093 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "611aebbd-06cc-46a9-ba2f-a01decf8d94a", "name": "network-vif-plugged", "status": "completed", "tag": "8206cdb6-1ac2-439c-8225-5f66c1635ad9"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:06:44.286044 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-ecdd1856-a409-42b8-a324-a06e354a2334 req-48c618bd-f831-486d-a9da-2f769ece5093 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:44.286885 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-ecdd1856-a409-42b8-a324-a06e354a2334 req-48c618bd-f831-486d-a9da-2f769ece5093 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:44.306581 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-ecdd1856-a409-42b8-a324-a06e354a2334 req-48c618bd-f831-486d-a9da-2f769ece5093 service nova] Creating event network-vif-plugged:8206cdb6-1ac2-439c-8225-5f66c1635ad9 for instance 611aebbd-06cc-46a9-ba2f-a01decf8d94a on hv-cinder-84051 May 30 12:06:44.331043 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-ecdd1856-a409-42b8-a324-a06e354a2334 req-48c618bd-f831-486d-a9da-2f769ece5093 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070622 May 30 12:06:44.332399 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 211/409] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:06:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:06:44.427532 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-1c472f2b-e1bb-4980-add7-d57821a8ad6e req-154bcf99-116e-4e12-b626-b489c42cc67d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83f672fe-d699-4f70-bc26-74dced714a5d", "tag": "e405a0d8-23b0-474a-be51-1a5734d329c4"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:06:44.468807 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-1c472f2b-e1bb-4980-add7-d57821a8ad6e req-154bcf99-116e-4e12-b626-b489c42cc67d service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:44.474567 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-1c472f2b-e1bb-4980-add7-d57821a8ad6e req-154bcf99-116e-4e12-b626-b489c42cc67d service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:44.493895 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-1c472f2b-e1bb-4980-add7-d57821a8ad6e req-154bcf99-116e-4e12-b626-b489c42cc67d service nova] Creating event network-changed:e405a0d8-23b0-474a-be51-1a5734d329c4 for instance 83f672fe-d699-4f70-bc26-74dced714a5d on hv-cinder-84051 May 30 12:06:44.511527 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-939bb32b-7553-4d26-865c-cff61dc91e1b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:44.512844 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-939bb32b-7553-4d26-865c-cff61dc91e1b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:44.522501 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-1c472f2b-e1bb-4980-add7-d57821a8ad6e req-154bcf99-116e-4e12-b626-b489c42cc67d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099388 May 30 12:06:44.524504 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 199/410] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:06:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 30 12:06:44.524622 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-939bb32b-7553-4d26-865c-cff61dc91e1b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:44.525415 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-939bb32b-7553-4d26-865c-cff61dc91e1b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:44.526475 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-939bb32b-7553-4d26-865c-cff61dc91e1b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:44.526888 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-939bb32b-7553-4d26-865c-cff61dc91e1b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:44.621997 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-12540619-8f5b-4e82-b970-518fa875eea4 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:44.623046 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-12540619-8f5b-4e82-b970-518fa875eea4 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: 611aebbd-06cc-46a9-ba2f-a01decf8d94a] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:44.642262 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-12540619-8f5b-4e82-b970-518fa875eea4 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:44.643723 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-12540619-8f5b-4e82-b970-518fa875eea4 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:44.647937 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-12540619-8f5b-4e82-b970-518fa875eea4 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:44.651758 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-12540619-8f5b-4e82-b970-518fa875eea4 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:44.805254 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-939bb32b-7553-4d26-865c-cff61dc91e1b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:44.820193 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-939bb32b-7553-4d26-865c-cff61dc91e1b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:44.821732 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-939bb32b-7553-4d26-865c-cff61dc91e1b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:44.826827 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-939bb32b-7553-4d26-865c-cff61dc91e1b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1739 microversion: 2.20 time: 0.319482 May 30 12:06:44.827676 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 212/411] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:06:44 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1739 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:06:44.973297 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-12540619-8f5b-4e82-b970-518fa875eea4 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7575179edbda45208561c983fc5b956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20763921c37c4e81bba702e09bf628b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:44.982298 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-12540619-8f5b-4e82-b970-518fa875eea4 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/611aebbd-06cc-46a9-ba2f-a01decf8d94a" status: 200 len: 1365 microversion: 2.1 time: 0.365783 May 30 12:06:44.984302 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 200/412] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:44 2022] GET /compute/v2.1/servers/611aebbd-06cc-46a9-ba2f-a01decf8d94a => generated 1365 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:06:45.848732 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-26cf3fce-c638-46b1-aad4-14b0f1aa23c2 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:45.850570 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-26cf3fce-c638-46b1-aad4-14b0f1aa23c2 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:45.859479 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-26cf3fce-c638-46b1-aad4-14b0f1aa23c2 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:45.860388 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-26cf3fce-c638-46b1-aad4-14b0f1aa23c2 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:45.861601 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-26cf3fce-c638-46b1-aad4-14b0f1aa23c2 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:45.862256 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-26cf3fce-c638-46b1-aad4-14b0f1aa23c2 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:46.003460 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-e0d11dab-da7e-464a-86a8-9086149e1d72 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:46.005034 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-e0d11dab-da7e-464a-86a8-9086149e1d72 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: 611aebbd-06cc-46a9-ba2f-a01decf8d94a] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:46.012018 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e0d11dab-da7e-464a-86a8-9086149e1d72 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:46.012851 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e0d11dab-da7e-464a-86a8-9086149e1d72 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:46.013854 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e0d11dab-da7e-464a-86a8-9086149e1d72 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:46.015221 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e0d11dab-da7e-464a-86a8-9086149e1d72 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:46.040382 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-26cf3fce-c638-46b1-aad4-14b0f1aa23c2 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:46.050066 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-26cf3fce-c638-46b1-aad4-14b0f1aa23c2 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:46.055364 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-26cf3fce-c638-46b1-aad4-14b0f1aa23c2 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:46.057635 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-26cf3fce-c638-46b1-aad4-14b0f1aa23c2 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1739 microversion: 2.20 time: 0.215748 May 30 12:06:46.058561 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 213/413] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:06:45 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1739 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:06:46.256482 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-e0d11dab-da7e-464a-86a8-9086149e1d72 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7575179edbda45208561c983fc5b956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20763921c37c4e81bba702e09bf628b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:46.268834 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-e0d11dab-da7e-464a-86a8-9086149e1d72 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/611aebbd-06cc-46a9-ba2f-a01decf8d94a" status: 200 len: 1365 microversion: 2.1 time: 0.269933 May 30 12:06:46.271298 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 201/414] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:45 2022] GET /compute/v2.1/servers/611aebbd-06cc-46a9-ba2f-a01decf8d94a => generated 1365 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:06:47.079559 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-dfe3f03c-d814-414d-bcf8-165d38332474 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:47.080986 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-dfe3f03c-d814-414d-bcf8-165d38332474 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:47.090874 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-dfe3f03c-d814-414d-bcf8-165d38332474 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:47.091428 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-dfe3f03c-d814-414d-bcf8-165d38332474 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:47.092947 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-dfe3f03c-d814-414d-bcf8-165d38332474 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:47.093569 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-dfe3f03c-d814-414d-bcf8-165d38332474 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:47.249596 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-dfe3f03c-d814-414d-bcf8-165d38332474 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:47.260794 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-dfe3f03c-d814-414d-bcf8-165d38332474 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:47.262321 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-dfe3f03c-d814-414d-bcf8-165d38332474 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:47.263700 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-dfe3f03c-d814-414d-bcf8-165d38332474 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1739 microversion: 2.20 time: 0.189640 May 30 12:06:47.275284 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 214/415] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:06:47 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1739 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:06:47.290377 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-56c2d927-f184-4bf3-93b9-58427a9cd32c tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:47.291202 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-56c2d927-f184-4bf3-93b9-58427a9cd32c tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: 611aebbd-06cc-46a9-ba2f-a01decf8d94a] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:47.300990 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-56c2d927-f184-4bf3-93b9-58427a9cd32c tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:47.303313 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-56c2d927-f184-4bf3-93b9-58427a9cd32c tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:47.304398 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-56c2d927-f184-4bf3-93b9-58427a9cd32c tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:47.305072 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-56c2d927-f184-4bf3-93b9-58427a9cd32c tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:47.488758 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-56c2d927-f184-4bf3-93b9-58427a9cd32c tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7575179edbda45208561c983fc5b956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20763921c37c4e81bba702e09bf628b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:47.500401 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-56c2d927-f184-4bf3-93b9-58427a9cd32c tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/611aebbd-06cc-46a9-ba2f-a01decf8d94a" status: 200 len: 1365 microversion: 2.1 time: 0.216303 May 30 12:06:47.501318 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 202/416] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:47 2022] GET /compute/v2.1/servers/611aebbd-06cc-46a9-ba2f-a01decf8d94a => generated 1365 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:06:48.289078 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-7466cb8e-1545-4acf-8415-ccdb00874d31 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:48.289861 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-7466cb8e-1545-4acf-8415-ccdb00874d31 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:48.302248 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7466cb8e-1545-4acf-8415-ccdb00874d31 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:48.302765 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7466cb8e-1545-4acf-8415-ccdb00874d31 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:48.303800 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7466cb8e-1545-4acf-8415-ccdb00874d31 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:48.304365 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7466cb8e-1545-4acf-8415-ccdb00874d31 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:48.518088 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-82efe407-02f7-4333-a67a-d7c7016d5bfe tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:48.519640 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-82efe407-02f7-4333-a67a-d7c7016d5bfe tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: 611aebbd-06cc-46a9-ba2f-a01decf8d94a] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:48.528144 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-82efe407-02f7-4333-a67a-d7c7016d5bfe tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:48.528993 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-82efe407-02f7-4333-a67a-d7c7016d5bfe tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:48.529346 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-7466cb8e-1545-4acf-8415-ccdb00874d31 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:48.530345 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-82efe407-02f7-4333-a67a-d7c7016d5bfe tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:48.531022 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-82efe407-02f7-4333-a67a-d7c7016d5bfe tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:48.541537 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-7466cb8e-1545-4acf-8415-ccdb00874d31 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:48.543643 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-7466cb8e-1545-4acf-8415-ccdb00874d31 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:48.545948 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-7466cb8e-1545-4acf-8415-ccdb00874d31 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1739 microversion: 2.20 time: 0.265583 May 30 12:06:48.559207 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 215/417] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:06:48 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1739 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:06:48.683221 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-82efe407-02f7-4333-a67a-d7c7016d5bfe tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7575179edbda45208561c983fc5b956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20763921c37c4e81bba702e09bf628b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:48.692284 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-82efe407-02f7-4333-a67a-d7c7016d5bfe tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/611aebbd-06cc-46a9-ba2f-a01decf8d94a" status: 200 len: 1554 microversion: 2.1 time: 0.178045 May 30 12:06:48.692866 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 203/418] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:06:48 2022] GET /compute/v2.1/servers/611aebbd-06cc-46a9-ba2f-a01decf8d94a => generated 1554 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:06:48.708960 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-20ef88f1-9a1e-4370-bd1f-cc2510a722c0 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:48.709575 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-20ef88f1-9a1e-4370-bd1f-cc2510a722c0 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: 611aebbd-06cc-46a9-ba2f-a01decf8d94a] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:48.715829 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-20ef88f1-9a1e-4370-bd1f-cc2510a722c0 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:48.717632 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-20ef88f1-9a1e-4370-bd1f-cc2510a722c0 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:48.718882 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-20ef88f1-9a1e-4370-bd1f-cc2510a722c0 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:48.719326 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-20ef88f1-9a1e-4370-bd1f-cc2510a722c0 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:48.805254 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-20ef88f1-9a1e-4370-bd1f-cc2510a722c0 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/611aebbd-06cc-46a9-ba2f-a01decf8d94a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100230 May 30 12:06:48.805840 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 216/419] 10.222.0.32 () {58 vars in 1274 bytes} [Mon May 30 12:06:48 2022] GET /compute/v2.1/servers/611aebbd-06cc-46a9-ba2f-a01decf8d94a/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:06:49.566004 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-4d3cc5c5-461a-49f4-bf7f-f3d9443ddaa4 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:49.566940 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-4d3cc5c5-461a-49f4-bf7f-f3d9443ddaa4 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:49.575172 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4d3cc5c5-461a-49f4-bf7f-f3d9443ddaa4 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:49.575884 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4d3cc5c5-461a-49f4-bf7f-f3d9443ddaa4 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:49.576715 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4d3cc5c5-461a-49f4-bf7f-f3d9443ddaa4 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:49.577386 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4d3cc5c5-461a-49f4-bf7f-f3d9443ddaa4 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:49.739124 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-4d3cc5c5-461a-49f4-bf7f-f3d9443ddaa4 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:49.747312 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-4d3cc5c5-461a-49f4-bf7f-f3d9443ddaa4 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:49.749282 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-4d3cc5c5-461a-49f4-bf7f-f3d9443ddaa4 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:49.750819 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-4d3cc5c5-461a-49f4-bf7f-f3d9443ddaa4 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1721 microversion: 2.20 time: 0.189306 May 30 12:06:49.751352 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 204/420] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:06:49 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1721 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:06:50.193606 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-16f1e9d7-ce48-47f7-9bde-1e55cb19bfc4 req-84d9b6ea-b322-4781-93f4-80f6798e5b98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "611aebbd-06cc-46a9-ba2f-a01decf8d94a", "tag": "8206cdb6-1ac2-439c-8225-5f66c1635ad9"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:06:50.215313 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-16f1e9d7-ce48-47f7-9bde-1e55cb19bfc4 req-84d9b6ea-b322-4781-93f4-80f6798e5b98 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:50.219065 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-16f1e9d7-ce48-47f7-9bde-1e55cb19bfc4 req-84d9b6ea-b322-4781-93f4-80f6798e5b98 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:50.256410 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-16f1e9d7-ce48-47f7-9bde-1e55cb19bfc4 req-84d9b6ea-b322-4781-93f4-80f6798e5b98 service nova] Creating event network-changed:8206cdb6-1ac2-439c-8225-5f66c1635ad9 for instance 611aebbd-06cc-46a9-ba2f-a01decf8d94a on hv-cinder-84051 May 30 12:06:50.256638 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-16f1e9d7-ce48-47f7-9bde-1e55cb19bfc4 req-84d9b6ea-b322-4781-93f4-80f6798e5b98 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066710 May 30 12:06:50.257356 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 217/421] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:06:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:06:50.771078 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-61add318-d85f-4e8e-95bf-1a0673dc6bb6 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:50.771710 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-61add318-d85f-4e8e-95bf-1a0673dc6bb6 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:50.777831 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-61add318-d85f-4e8e-95bf-1a0673dc6bb6 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:50.778277 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-61add318-d85f-4e8e-95bf-1a0673dc6bb6 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:50.779045 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-61add318-d85f-4e8e-95bf-1a0673dc6bb6 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:50.779481 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-61add318-d85f-4e8e-95bf-1a0673dc6bb6 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:50.934408 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-61add318-d85f-4e8e-95bf-1a0673dc6bb6 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:50.943547 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-61add318-d85f-4e8e-95bf-1a0673dc6bb6 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:50.945078 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-61add318-d85f-4e8e-95bf-1a0673dc6bb6 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:50.946238 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-61add318-d85f-4e8e-95bf-1a0673dc6bb6 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1721 microversion: 2.20 time: 0.179872 May 30 12:06:50.946808 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 205/422] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:06:50 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1721 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:06:51.965159 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-276b7932-89d7-48c3-8b5c-e5a6cb230301 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:51.965777 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-276b7932-89d7-48c3-8b5c-e5a6cb230301 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:51.972971 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-276b7932-89d7-48c3-8b5c-e5a6cb230301 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:51.973423 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-276b7932-89d7-48c3-8b5c-e5a6cb230301 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:51.974197 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-276b7932-89d7-48c3-8b5c-e5a6cb230301 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:51.974629 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-276b7932-89d7-48c3-8b5c-e5a6cb230301 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:52.107553 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-276b7932-89d7-48c3-8b5c-e5a6cb230301 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:52.115820 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-276b7932-89d7-48c3-8b5c-e5a6cb230301 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:52.117301 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-276b7932-89d7-48c3-8b5c-e5a6cb230301 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:52.118464 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-276b7932-89d7-48c3-8b5c-e5a6cb230301 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1721 microversion: 2.20 time: 0.157988 May 30 12:06:52.119023 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 218/423] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:06:51 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:06:52.835273 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-0e5808cf-c342-44d6-8c76-e8de73033d46 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "327e0152-5919-4327-aef9-89274512223d", "device": "/dev/sdb"}} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:06:52.837007 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-0e5808cf-c342-44d6-8c76-e8de73033d46 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] [instance: 11600577-2336-4fdd-b0f0-78fbf42f8ea1] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:52.843512 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-0e5808cf-c342-44d6-8c76-e8de73033d46 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:52.844309 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-0e5808cf-c342-44d6-8c76-e8de73033d46 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:52.845017 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-0e5808cf-c342-44d6-8c76-e8de73033d46 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:52.845602 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-0e5808cf-c342-44d6-8c76-e8de73033d46 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:53.135499 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-0e5808cf-c342-44d6-8c76-e8de73033d46 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] 10.222.0.32 "POST /compute/v2.1/servers/11600577-2336-4fdd-b0f0-78fbf42f8ea1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.304133 May 30 12:06:53.136133 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 206/424] 10.222.0.32 () {60 vars in 1322 bytes} [Mon May 30 12:06:52 2022] POST /compute/v2.1/servers/11600577-2336-4fdd-b0f0-78fbf42f8ea1/os-volume_attachments => generated 194 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:06:53.136460 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-e423fdf5-2f51-4715-8b94-b64377eeff3b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:53.137168 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-e423fdf5-2f51-4715-8b94-b64377eeff3b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:53.144976 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e423fdf5-2f51-4715-8b94-b64377eeff3b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:53.145433 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e423fdf5-2f51-4715-8b94-b64377eeff3b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:53.146240 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e423fdf5-2f51-4715-8b94-b64377eeff3b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:53.147029 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e423fdf5-2f51-4715-8b94-b64377eeff3b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:53.288186 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-e423fdf5-2f51-4715-8b94-b64377eeff3b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:53.297650 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-e423fdf5-2f51-4715-8b94-b64377eeff3b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:53.299307 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-e423fdf5-2f51-4715-8b94-b64377eeff3b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:53.300582 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-e423fdf5-2f51-4715-8b94-b64377eeff3b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1664 microversion: 2.20 time: 0.167930 May 30 12:06:53.301137 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 219/425] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:06:53 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1664 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 30 12:06:53.320204 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-93f8797c-29f6-45b3-8968-9d07ce23e51a tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "10a317d3-33ef-4efa-bb3b-11b734894339"}} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:06:53.321476 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-93f8797c-29f6-45b3-8968-9d07ce23e51a tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:53.329186 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-93f8797c-29f6-45b3-8968-9d07ce23e51a tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:53.329635 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-93f8797c-29f6-45b3-8968-9d07ce23e51a tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:53.330397 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-93f8797c-29f6-45b3-8968-9d07ce23e51a tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:53.330825 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-93f8797c-29f6-45b3-8968-9d07ce23e51a tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:53.514536 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:53.620061 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-93f8797c-29f6-45b3-8968-9d07ce23e51a tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "POST /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.305193 May 30 12:06:53.620982 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 207/426] 10.222.0.32 () {62 vars in 1363 bytes} [Mon May 30 12:06:53 2022] POST /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c/os-volume_attachments => generated 188 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 30 12:06:53.737289 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-77783af1-9377-4640-8794-24a6610f379a tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:06:53.737860 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-77783af1-9377-4640-8794-24a6610f379a tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:53.743889 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-77783af1-9377-4640-8794-24a6610f379a tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:53.744382 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-77783af1-9377-4640-8794-24a6610f379a tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:53.745146 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-77783af1-9377-4640-8794-24a6610f379a tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:53.745581 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-77783af1-9377-4640-8794-24a6610f379a tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:53.836250 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-77783af1-9377-4640-8794-24a6610f379a tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "POST /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c/action" status: 202 len: 0 microversion: 2.20 time: 0.102780 May 30 12:06:53.836803 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 220/427] 10.222.0.32 () {62 vars in 1318 bytes} [Mon May 30 12:06:53 2022] POST /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 30 12:06:53.845009 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-4e6bd801-1111-4e25-9a48-23b9f1ace0c7 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:53.845617 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-4e6bd801-1111-4e25-9a48-23b9f1ace0c7 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:53.848031 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_api:SELECT=86 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:53.853231 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4e6bd801-1111-4e25-9a48-23b9f1ace0c7 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:53.853676 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4e6bd801-1111-4e25-9a48-23b9f1ace0c7 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:53.854462 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4e6bd801-1111-4e25-9a48-23b9f1ace0c7 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:53.854872 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4e6bd801-1111-4e25-9a48-23b9f1ace0c7 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:53.993089 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-4e6bd801-1111-4e25-9a48-23b9f1ace0c7 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:54.003084 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-4e6bd801-1111-4e25-9a48-23b9f1ace0c7 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:54.004643 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-4e6bd801-1111-4e25-9a48-23b9f1ace0c7 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:54.005804 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-4e6bd801-1111-4e25-9a48-23b9f1ace0c7 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1750 microversion: 2.20 time: 0.164727 May 30 12:06:54.006362 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 208/428] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:06:53 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1750 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:06:54.166619 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-6a9d7936-b84e-4ee1-b9d5-56351a5f5451 req-6e46999b-e6f1-4e74-bdf8-b24bd24cf83e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "314658c0-2ad4-4987-99bc-f8acf2d7e46c", "name": "network-vif-unplugged", "status": "completed", "tag": "66de87a6-f3b1-41fb-8926-85240efcbe51"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:06:54.184220 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-6a9d7936-b84e-4ee1-b9d5-56351a5f5451 req-6e46999b-e6f1-4e74-bdf8-b24bd24cf83e service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:54.184673 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-6a9d7936-b84e-4ee1-b9d5-56351a5f5451 req-6e46999b-e6f1-4e74-bdf8-b24bd24cf83e service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:54.204855 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.compute.server_external_events [req-6a9d7936-b84e-4ee1-b9d5-56351a5f5451 req-6e46999b-e6f1-4e74-bdf8-b24bd24cf83e service nova] Unable to find a host for instance 314658c0-2ad4-4987-99bc-f8acf2d7e46c. Dropping event network-vif-unplugged {{(pid=117671) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 30 12:06:54.205800 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-6a9d7936-b84e-4ee1-b9d5-56351a5f5451 req-6e46999b-e6f1-4e74-bdf8-b24bd24cf83e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.045469 May 30 12:06:54.206741 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 221/429] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:06:54 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 47 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 30 12:06:55.026364 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-ba325588-4cf9-4877-b453-99362d6146e1 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:55.027197 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-ba325588-4cf9-4877-b453-99362d6146e1 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:55.034381 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ba325588-4cf9-4877-b453-99362d6146e1 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:55.035063 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ba325588-4cf9-4877-b453-99362d6146e1 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:55.035920 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ba325588-4cf9-4877-b453-99362d6146e1 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:55.036454 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ba325588-4cf9-4877-b453-99362d6146e1 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:55.185201 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-ba325588-4cf9-4877-b453-99362d6146e1 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:55.196106 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-ba325588-4cf9-4877-b453-99362d6146e1 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:55.197709 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-ba325588-4cf9-4877-b453-99362d6146e1 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:55.199049 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-ba325588-4cf9-4877-b453-99362d6146e1 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1750 microversion: 2.20 time: 0.176797 May 30 12:06:55.199691 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 209/430] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:06:55 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1750 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:06:56.218086 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-8ee9114e-c67e-4195-93ef-6d9df6337bbb tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:56.218711 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-8ee9114e-c67e-4195-93ef-6d9df6337bbb tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:56.225905 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8ee9114e-c67e-4195-93ef-6d9df6337bbb tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:56.226361 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8ee9114e-c67e-4195-93ef-6d9df6337bbb tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:56.227197 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8ee9114e-c67e-4195-93ef-6d9df6337bbb tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:56.227634 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8ee9114e-c67e-4195-93ef-6d9df6337bbb tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:56.386384 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-8ee9114e-c67e-4195-93ef-6d9df6337bbb tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:56.397981 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-8ee9114e-c67e-4195-93ef-6d9df6337bbb tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:56.399771 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-8ee9114e-c67e-4195-93ef-6d9df6337bbb tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:56.401153 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-8ee9114e-c67e-4195-93ef-6d9df6337bbb tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1752 microversion: 2.20 time: 0.187534 May 30 12:06:56.401702 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 222/431] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:06:56 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1752 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:06:57.418665 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-8f4cfa6a-d01b-4236-8b94-583381d0bfe4 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:57.419273 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-8f4cfa6a-d01b-4236-8b94-583381d0bfe4 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:57.426575 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8f4cfa6a-d01b-4236-8b94-583381d0bfe4 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:57.426954 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8f4cfa6a-d01b-4236-8b94-583381d0bfe4 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:57.427761 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8f4cfa6a-d01b-4236-8b94-583381d0bfe4 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:57.428346 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8f4cfa6a-d01b-4236-8b94-583381d0bfe4 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:57.559664 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-8f4cfa6a-d01b-4236-8b94-583381d0bfe4 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:57.568578 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-8f4cfa6a-d01b-4236-8b94-583381d0bfe4 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:57.570017 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-8f4cfa6a-d01b-4236-8b94-583381d0bfe4 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:57.571178 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-8f4cfa6a-d01b-4236-8b94-583381d0bfe4 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1752 microversion: 2.20 time: 0.156340 May 30 12:06:57.571739 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 210/432] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:06:57 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:06:58.589487 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-0cb1dacc-0be3-4182-b8d8-c4e6698680ca tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:58.590102 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-0cb1dacc-0be3-4182-b8d8-c4e6698680ca tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:58.597093 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0cb1dacc-0be3-4182-b8d8-c4e6698680ca tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:58.597549 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0cb1dacc-0be3-4182-b8d8-c4e6698680ca tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:58.598405 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0cb1dacc-0be3-4182-b8d8-c4e6698680ca tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:58.598842 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0cb1dacc-0be3-4182-b8d8-c4e6698680ca tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:58.747625 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-0cb1dacc-0be3-4182-b8d8-c4e6698680ca tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:58.756742 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-0cb1dacc-0be3-4182-b8d8-c4e6698680ca tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:58.758214 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-0cb1dacc-0be3-4182-b8d8-c4e6698680ca tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:58.759437 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-0cb1dacc-0be3-4182-b8d8-c4e6698680ca tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1752 microversion: 2.20 time: 0.173822 May 30 12:06:58.759994 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 223/433] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:06:58 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1752 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:06:59.777929 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-1f69fab7-4cdb-40b7-87c0-17e262e849ea tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:59.778457 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-1f69fab7-4cdb-40b7-87c0-17e262e849ea tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:59.785605 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1f69fab7-4cdb-40b7-87c0-17e262e849ea tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:59.786056 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1f69fab7-4cdb-40b7-87c0-17e262e849ea tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:59.786825 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1f69fab7-4cdb-40b7-87c0-17e262e849ea tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:59.787248 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1f69fab7-4cdb-40b7-87c0-17e262e849ea tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:59.929727 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-1f69fab7-4cdb-40b7-87c0-17e262e849ea tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:59.939475 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-1f69fab7-4cdb-40b7-87c0-17e262e849ea tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:59.941254 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-1f69fab7-4cdb-40b7-87c0-17e262e849ea tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:59.942527 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-1f69fab7-4cdb-40b7-87c0-17e262e849ea tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1752 microversion: 2.20 time: 0.168519 May 30 12:06:59.943134 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 211/434] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:06:59 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1752 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:07:00.960817 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-71b794ee-90f1-45df-96da-715da615af3b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:00.961573 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-71b794ee-90f1-45df-96da-715da615af3b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:00.970205 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-71b794ee-90f1-45df-96da-715da615af3b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:00.970656 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-71b794ee-90f1-45df-96da-715da615af3b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:00.971444 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-71b794ee-90f1-45df-96da-715da615af3b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:00.971882 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-71b794ee-90f1-45df-96da-715da615af3b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:01.122034 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-71b794ee-90f1-45df-96da-715da615af3b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:01.131931 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-71b794ee-90f1-45df-96da-715da615af3b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:01.133794 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-71b794ee-90f1-45df-96da-715da615af3b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:01.135160 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-71b794ee-90f1-45df-96da-715da615af3b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1808 microversion: 2.20 time: 0.178335 May 30 12:07:01.135847 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 224/435] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:07:00 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:07:02.154597 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-eb811297-1575-4a1f-9c61-84904cb35d91 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:02.155241 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-eb811297-1575-4a1f-9c61-84904cb35d91 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:02.161755 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-eb811297-1575-4a1f-9c61-84904cb35d91 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:02.162148 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-eb811297-1575-4a1f-9c61-84904cb35d91 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:02.162907 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-eb811297-1575-4a1f-9c61-84904cb35d91 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:02.163338 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-eb811297-1575-4a1f-9c61-84904cb35d91 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:02.292435 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-eb811297-1575-4a1f-9c61-84904cb35d91 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:02.301689 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-eb811297-1575-4a1f-9c61-84904cb35d91 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:02.303198 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-eb811297-1575-4a1f-9c61-84904cb35d91 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:02.304398 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-eb811297-1575-4a1f-9c61-84904cb35d91 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1808 microversion: 2.20 time: 0.153842 May 30 12:07:02.304957 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 212/436] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:07:02 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:07:03.322890 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-4d35c2c9-c902-4c41-9049-1ee58ff6ef3e tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:03.323490 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-4d35c2c9-c902-4c41-9049-1ee58ff6ef3e tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:03.331132 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4d35c2c9-c902-4c41-9049-1ee58ff6ef3e tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:03.331571 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4d35c2c9-c902-4c41-9049-1ee58ff6ef3e tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:03.332373 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4d35c2c9-c902-4c41-9049-1ee58ff6ef3e tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:03.332801 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4d35c2c9-c902-4c41-9049-1ee58ff6ef3e tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:03.466349 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-4d35c2c9-c902-4c41-9049-1ee58ff6ef3e tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:03.474768 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-4d35c2c9-c902-4c41-9049-1ee58ff6ef3e tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:03.476323 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-4d35c2c9-c902-4c41-9049-1ee58ff6ef3e tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:03.477493 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-4d35c2c9-c902-4c41-9049-1ee58ff6ef3e tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1808 microversion: 2.20 time: 0.158488 May 30 12:07:03.478060 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 225/437] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:07:03 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:07:04.494895 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-c276c26f-8002-4383-a01f-f2f149bb2882 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:04.495418 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-c276c26f-8002-4383-a01f-f2f149bb2882 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:04.503481 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c276c26f-8002-4383-a01f-f2f149bb2882 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:04.503934 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c276c26f-8002-4383-a01f-f2f149bb2882 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:04.504741 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c276c26f-8002-4383-a01f-f2f149bb2882 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:04.505182 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c276c26f-8002-4383-a01f-f2f149bb2882 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:04.648044 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-c276c26f-8002-4383-a01f-f2f149bb2882 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:04.657310 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-c276c26f-8002-4383-a01f-f2f149bb2882 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:04.658826 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-c276c26f-8002-4383-a01f-f2f149bb2882 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:04.660012 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-c276c26f-8002-4383-a01f-f2f149bb2882 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1808 microversion: 2.20 time: 0.169111 May 30 12:07:04.660630 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 213/438] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:07:04 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:07:05.678860 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-ed431ac3-61a4-44e6-9b21-4397ecc7451a tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:05.679647 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-ed431ac3-61a4-44e6-9b21-4397ecc7451a tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:05.687702 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ed431ac3-61a4-44e6-9b21-4397ecc7451a tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:05.688541 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ed431ac3-61a4-44e6-9b21-4397ecc7451a tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:05.689526 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ed431ac3-61a4-44e6-9b21-4397ecc7451a tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:05.690121 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ed431ac3-61a4-44e6-9b21-4397ecc7451a tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:05.830493 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-ed431ac3-61a4-44e6-9b21-4397ecc7451a tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:05.839560 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-ed431ac3-61a4-44e6-9b21-4397ecc7451a tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:05.841126 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-ed431ac3-61a4-44e6-9b21-4397ecc7451a tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:05.842300 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-ed431ac3-61a4-44e6-9b21-4397ecc7451a tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1808 microversion: 2.20 time: 0.167384 May 30 12:07:05.843397 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 226/439] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:07:05 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:07:06.861936 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-d11e45f0-9ed3-4f13-b759-29d8511f3a8d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:06.862515 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-d11e45f0-9ed3-4f13-b759-29d8511f3a8d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:06.869159 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d11e45f0-9ed3-4f13-b759-29d8511f3a8d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:06.869614 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d11e45f0-9ed3-4f13-b759-29d8511f3a8d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:06.870390 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d11e45f0-9ed3-4f13-b759-29d8511f3a8d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:06.870833 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d11e45f0-9ed3-4f13-b759-29d8511f3a8d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:07.027091 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-d11e45f0-9ed3-4f13-b759-29d8511f3a8d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:07.036507 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-d11e45f0-9ed3-4f13-b759-29d8511f3a8d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:07.038043 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-d11e45f0-9ed3-4f13-b759-29d8511f3a8d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:07.039268 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-d11e45f0-9ed3-4f13-b759-29d8511f3a8d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1808 microversion: 2.20 time: 0.181727 May 30 12:07:07.039830 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 214/440] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:07:06 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:07:08.057917 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-9da67390-0fd6-4ba1-b60d-7ad605bad321 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:08.058518 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-9da67390-0fd6-4ba1-b60d-7ad605bad321 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:08.065900 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9da67390-0fd6-4ba1-b60d-7ad605bad321 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:08.066345 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9da67390-0fd6-4ba1-b60d-7ad605bad321 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:08.067110 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9da67390-0fd6-4ba1-b60d-7ad605bad321 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:08.067547 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9da67390-0fd6-4ba1-b60d-7ad605bad321 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:08.211520 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-9da67390-0fd6-4ba1-b60d-7ad605bad321 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:08.214023 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:08.222465 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-9da67390-0fd6-4ba1-b60d-7ad605bad321 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:08.224084 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-9da67390-0fd6-4ba1-b60d-7ad605bad321 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:08.225299 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-9da67390-0fd6-4ba1-b60d-7ad605bad321 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1808 microversion: 2.20 time: 0.171325 May 30 12:07:08.225861 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 227/441] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:07:08 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:07:09.243011 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-3e3567b9-d0c5-4639-ac07-06c51117d08b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:09.243623 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-3e3567b9-d0c5-4639-ac07-06c51117d08b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:09.250948 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3e3567b9-d0c5-4639-ac07-06c51117d08b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:09.251399 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3e3567b9-d0c5-4639-ac07-06c51117d08b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:09.252191 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3e3567b9-d0c5-4639-ac07-06c51117d08b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:09.252628 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3e3567b9-d0c5-4639-ac07-06c51117d08b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:09.399953 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-3e3567b9-d0c5-4639-ac07-06c51117d08b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:09.411310 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-3e3567b9-d0c5-4639-ac07-06c51117d08b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:09.412868 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-3e3567b9-d0c5-4639-ac07-06c51117d08b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:09.414176 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-3e3567b9-d0c5-4639-ac07-06c51117d08b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1808 microversion: 2.20 time: 0.175072 May 30 12:07:09.414741 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 215/442] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:07:09 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:07:10.434121 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-85c9bf10-d497-4b56-aca2-8f643bd93bd4 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:10.434741 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-85c9bf10-d497-4b56-aca2-8f643bd93bd4 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:10.442332 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-85c9bf10-d497-4b56-aca2-8f643bd93bd4 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:10.442782 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-85c9bf10-d497-4b56-aca2-8f643bd93bd4 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:10.443562 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-85c9bf10-d497-4b56-aca2-8f643bd93bd4 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:10.443992 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-85c9bf10-d497-4b56-aca2-8f643bd93bd4 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:10.587335 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-85c9bf10-d497-4b56-aca2-8f643bd93bd4 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:10.597623 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-85c9bf10-d497-4b56-aca2-8f643bd93bd4 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:10.599448 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-85c9bf10-d497-4b56-aca2-8f643bd93bd4 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:10.601037 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-85c9bf10-d497-4b56-aca2-8f643bd93bd4 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1808 microversion: 2.20 time: 0.171805 May 30 12:07:10.611152 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 228/443] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:07:10 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1808 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:07:11.621063 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-3f36aaa6-2694-43ea-b4a5-e12dd96bb13c tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:11.622396 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-3f36aaa6-2694-43ea-b4a5-e12dd96bb13c tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:11.631575 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3f36aaa6-2694-43ea-b4a5-e12dd96bb13c tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:11.632097 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3f36aaa6-2694-43ea-b4a5-e12dd96bb13c tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:11.632977 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3f36aaa6-2694-43ea-b4a5-e12dd96bb13c tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:11.633487 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3f36aaa6-2694-43ea-b4a5-e12dd96bb13c tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:11.786972 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-3f36aaa6-2694-43ea-b4a5-e12dd96bb13c tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:11.795961 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-3f36aaa6-2694-43ea-b4a5-e12dd96bb13c tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:11.797521 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-3f36aaa6-2694-43ea-b4a5-e12dd96bb13c tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:11.798694 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-3f36aaa6-2694-43ea-b4a5-e12dd96bb13c tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1808 microversion: 2.20 time: 0.181595 May 30 12:07:11.807645 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 216/444] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:07:11 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:07:12.817509 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-55461470-e8d9-4a7f-a789-8ab03f8896e1 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:12.818139 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-55461470-e8d9-4a7f-a789-8ab03f8896e1 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:12.820486 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_api:SELECT=46 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:12.825846 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-55461470-e8d9-4a7f-a789-8ab03f8896e1 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:12.826297 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-55461470-e8d9-4a7f-a789-8ab03f8896e1 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:12.827607 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-55461470-e8d9-4a7f-a789-8ab03f8896e1 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:12.828045 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-55461470-e8d9-4a7f-a789-8ab03f8896e1 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:12.971396 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-55461470-e8d9-4a7f-a789-8ab03f8896e1 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:12.980386 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-55461470-e8d9-4a7f-a789-8ab03f8896e1 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:12.981946 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-55461470-e8d9-4a7f-a789-8ab03f8896e1 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:12.983329 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-55461470-e8d9-4a7f-a789-8ab03f8896e1 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1808 microversion: 2.20 time: 0.169647 May 30 12:07:12.984064 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 229/445] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:07:12 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:07:14.002622 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-ee078404-45f9-447d-bb94-3500b3081d61 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:14.003184 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-ee078404-45f9-447d-bb94-3500b3081d61 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:14.009933 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ee078404-45f9-447d-bb94-3500b3081d61 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:14.010519 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ee078404-45f9-447d-bb94-3500b3081d61 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:14.011321 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ee078404-45f9-447d-bb94-3500b3081d61 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:14.011754 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ee078404-45f9-447d-bb94-3500b3081d61 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:14.163231 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-ee078404-45f9-447d-bb94-3500b3081d61 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:14.171762 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-ee078404-45f9-447d-bb94-3500b3081d61 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:14.173301 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-ee078404-45f9-447d-bb94-3500b3081d61 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:14.174488 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-ee078404-45f9-447d-bb94-3500b3081d61 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1808 microversion: 2.20 time: 0.175909 May 30 12:07:14.175051 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 217/446] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:07:13 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:07:15.194318 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-82702832-1cb8-41d9-a52d-7328884c94ef tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:15.194910 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-82702832-1cb8-41d9-a52d-7328884c94ef tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:15.202013 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-82702832-1cb8-41d9-a52d-7328884c94ef tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:15.202757 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-82702832-1cb8-41d9-a52d-7328884c94ef tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:15.203657 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-82702832-1cb8-41d9-a52d-7328884c94ef tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:15.204090 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-82702832-1cb8-41d9-a52d-7328884c94ef tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:15.357614 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-82702832-1cb8-41d9-a52d-7328884c94ef tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:15.367416 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-82702832-1cb8-41d9-a52d-7328884c94ef tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:15.368958 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-82702832-1cb8-41d9-a52d-7328884c94ef tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:15.370228 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-82702832-1cb8-41d9-a52d-7328884c94ef tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1808 microversion: 2.20 time: 0.180147 May 30 12:07:15.370794 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 230/447] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:07:15 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1808 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:07:16.389509 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-152e78a4-17f4-45a2-9c67-8534c2a10f61 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:16.390153 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-152e78a4-17f4-45a2-9c67-8534c2a10f61 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:16.397488 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-152e78a4-17f4-45a2-9c67-8534c2a10f61 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:16.397932 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-152e78a4-17f4-45a2-9c67-8534c2a10f61 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:16.398712 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-152e78a4-17f4-45a2-9c67-8534c2a10f61 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:16.399145 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-152e78a4-17f4-45a2-9c67-8534c2a10f61 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:16.533833 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-152e78a4-17f4-45a2-9c67-8534c2a10f61 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:16.542899 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-152e78a4-17f4-45a2-9c67-8534c2a10f61 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:16.544439 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-152e78a4-17f4-45a2-9c67-8534c2a10f61 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:16.545613 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-152e78a4-17f4-45a2-9c67-8534c2a10f61 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1808 microversion: 2.20 time: 0.160130 May 30 12:07:16.546173 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 218/448] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:07:16 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:07:17.565548 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-96031a96-a6d0-403e-aa38-6c52f6d1920a tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:17.566176 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-96031a96-a6d0-403e-aa38-6c52f6d1920a tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:17.573344 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-96031a96-a6d0-403e-aa38-6c52f6d1920a tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:17.573797 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-96031a96-a6d0-403e-aa38-6c52f6d1920a tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:17.574573 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-96031a96-a6d0-403e-aa38-6c52f6d1920a tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:17.575011 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-96031a96-a6d0-403e-aa38-6c52f6d1920a tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:17.708728 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-96031a96-a6d0-403e-aa38-6c52f6d1920a tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:17.717181 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-96031a96-a6d0-403e-aa38-6c52f6d1920a tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:17.718769 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-96031a96-a6d0-403e-aa38-6c52f6d1920a tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:17.720255 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-96031a96-a6d0-403e-aa38-6c52f6d1920a tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1808 microversion: 2.20 time: 0.159030 May 30 12:07:17.720847 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 231/449] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:07:17 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:07:18.075186 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-ca00231e-445a-4656-8550-059a048f82e9 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:18.075694 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-ca00231e-445a-4656-8550-059a048f82e9 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] [instance: 11600577-2336-4fdd-b0f0-78fbf42f8ea1] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:18.082574 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ca00231e-445a-4656-8550-059a048f82e9 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:18.083026 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ca00231e-445a-4656-8550-059a048f82e9 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:18.083795 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ca00231e-445a-4656-8550-059a048f82e9 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:18.084267 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ca00231e-445a-4656-8550-059a048f82e9 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:18.218116 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.objects.instance [None req-ca00231e-445a-4656-8550-059a048f82e9 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lazy-loading 'services' on Instance uuid 11600577-2336-4fdd-b0f0-78fbf42f8ea1 {{(pid=117670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 30 12:07:18.347895 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-ca00231e-445a-4656-8550-059a048f82e9 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] 10.222.0.32 "DELETE /compute/v2.1/servers/11600577-2336-4fdd-b0f0-78fbf42f8ea1/os-volume_attachments/327e0152-5919-4327-aef9-89274512223d" status: 202 len: 0 microversion: 2.1 time: 0.276385 May 30 12:07:18.348519 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 219/450] 10.222.0.32 () {58 vars in 1415 bytes} [Mon May 30 12:07:18 2022] DELETE /compute/v2.1/servers/11600577-2336-4fdd-b0f0-78fbf42f8ea1/os-volume_attachments/327e0152-5919-4327-aef9-89274512223d => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 30 12:07:18.738986 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-3f14f421-c334-44bd-ab54-37e33b4dce64 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:18.739811 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-3f14f421-c334-44bd-ab54-37e33b4dce64 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:18.747898 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3f14f421-c334-44bd-ab54-37e33b4dce64 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:18.748439 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3f14f421-c334-44bd-ab54-37e33b4dce64 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:18.749231 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3f14f421-c334-44bd-ab54-37e33b4dce64 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:18.749811 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3f14f421-c334-44bd-ab54-37e33b4dce64 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:18.911401 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-3f14f421-c334-44bd-ab54-37e33b4dce64 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:18.920058 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-3f14f421-c334-44bd-ab54-37e33b4dce64 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:18.921612 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-3f14f421-c334-44bd-ab54-37e33b4dce64 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:18.923295 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-3f14f421-c334-44bd-ab54-37e33b4dce64 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1808 microversion: 2.20 time: 0.188298 May 30 12:07:18.924122 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 232/451] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:07:18 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1808 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:07:19.943866 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-2d8c2bee-ea82-4b9e-ba62-6a741f6fdaab tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:19.944572 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-2d8c2bee-ea82-4b9e-ba62-6a741f6fdaab tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:19.950789 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2d8c2bee-ea82-4b9e-ba62-6a741f6fdaab tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:19.951264 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2d8c2bee-ea82-4b9e-ba62-6a741f6fdaab tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:19.952024 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2d8c2bee-ea82-4b9e-ba62-6a741f6fdaab tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:19.952494 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2d8c2bee-ea82-4b9e-ba62-6a741f6fdaab tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:20.084738 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-2d8c2bee-ea82-4b9e-ba62-6a741f6fdaab tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:20.093126 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-2d8c2bee-ea82-4b9e-ba62-6a741f6fdaab tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:20.094785 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-2d8c2bee-ea82-4b9e-ba62-6a741f6fdaab tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:20.095949 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-2d8c2bee-ea82-4b9e-ba62-6a741f6fdaab tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1808 microversion: 2.20 time: 0.157053 May 30 12:07:20.096548 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 220/452] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:07:19 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:07:20.520865 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-a5eb9921-df1c-44f8-8b58-20103c56039a tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:20.521383 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-a5eb9921-df1c-44f8-8b58-20103c56039a tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] [instance: 11600577-2336-4fdd-b0f0-78fbf42f8ea1] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:20.527878 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a5eb9921-df1c-44f8-8b58-20103c56039a tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:20.528363 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a5eb9921-df1c-44f8-8b58-20103c56039a tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:20.529124 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a5eb9921-df1c-44f8-8b58-20103c56039a tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:20.529555 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a5eb9921-df1c-44f8-8b58-20103c56039a tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:20.554963 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-a5eb9921-df1c-44f8-8b58-20103c56039a tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] [instance: 11600577-2336-4fdd-b0f0-78fbf42f8ea1] Going to try to terminate instance {{(pid=117671) delete /opt/stack/nova/nova/compute/api.py:2664}} May 30 12:07:20.632749 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-a5eb9921-df1c-44f8-8b58-20103c56039a tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] 10.222.0.32 "DELETE /compute/v2.1/servers/11600577-2336-4fdd-b0f0-78fbf42f8ea1" status: 204 len: 0 microversion: 2.1 time: 0.115270 May 30 12:07:20.633506 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 233/453] 10.222.0.32 () {58 vars in 1238 bytes} [Mon May 30 12:07:20 2022] DELETE /compute/v2.1/servers/11600577-2336-4fdd-b0f0-78fbf42f8ea1 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 30 12:07:20.641849 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-5cbc281a-1265-4b61-920e-b321e93a8ed8 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:20.642636 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-5cbc281a-1265-4b61-920e-b321e93a8ed8 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] [instance: 11600577-2336-4fdd-b0f0-78fbf42f8ea1] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:20.649068 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5cbc281a-1265-4b61-920e-b321e93a8ed8 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:20.649539 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5cbc281a-1265-4b61-920e-b321e93a8ed8 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:20.650326 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5cbc281a-1265-4b61-920e-b321e93a8ed8 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:20.650763 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5cbc281a-1265-4b61-920e-b321e93a8ed8 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:20.782419 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-5cbc281a-1265-4b61-920e-b321e93a8ed8 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4c83a1ccfc43beb3f48e4462b06794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cd1e0377594f52bb5bfa7159731d48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:20.789938 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-5cbc281a-1265-4b61-920e-b321e93a8ed8 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] 10.222.0.32 "GET /compute/v2.1/servers/11600577-2336-4fdd-b0f0-78fbf42f8ea1" status: 200 len: 1513 microversion: 2.1 time: 0.152174 May 30 12:07:20.790506 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 221/454] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:07:20 2022] GET /compute/v2.1/servers/11600577-2336-4fdd-b0f0-78fbf42f8ea1 => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:21.114845 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-69f1fb81-04e6-45d8-86cd-d8e828769e29 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:21.115544 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-69f1fb81-04e6-45d8-86cd-d8e828769e29 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:21.121581 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-69f1fb81-04e6-45d8-86cd-d8e828769e29 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:21.122030 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-69f1fb81-04e6-45d8-86cd-d8e828769e29 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:21.122805 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-69f1fb81-04e6-45d8-86cd-d8e828769e29 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:21.123240 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-69f1fb81-04e6-45d8-86cd-d8e828769e29 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:21.253320 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-69f1fb81-04e6-45d8-86cd-d8e828769e29 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:21.261685 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-69f1fb81-04e6-45d8-86cd-d8e828769e29 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:21.263183 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-69f1fb81-04e6-45d8-86cd-d8e828769e29 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:21.264383 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-69f1fb81-04e6-45d8-86cd-d8e828769e29 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1808 microversion: 2.20 time: 0.153981 May 30 12:07:21.265252 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 234/455] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:07:21 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:07:21.807923 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-47fa351f-e807-40c6-89c1-7eb90b4e0c75 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:21.808821 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-47fa351f-e807-40c6-89c1-7eb90b4e0c75 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] [instance: 11600577-2336-4fdd-b0f0-78fbf42f8ea1] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:21.816068 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-47fa351f-e807-40c6-89c1-7eb90b4e0c75 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:21.816578 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-47fa351f-e807-40c6-89c1-7eb90b4e0c75 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:21.817360 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-47fa351f-e807-40c6-89c1-7eb90b4e0c75 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:21.817793 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-47fa351f-e807-40c6-89c1-7eb90b4e0c75 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:21.822366 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=94,nova_cell1:UPDATE=3 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:21.949820 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-47fa351f-e807-40c6-89c1-7eb90b4e0c75 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4c83a1ccfc43beb3f48e4462b06794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cd1e0377594f52bb5bfa7159731d48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:21.957557 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-47fa351f-e807-40c6-89c1-7eb90b4e0c75 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] 10.222.0.32 "GET /compute/v2.1/servers/11600577-2336-4fdd-b0f0-78fbf42f8ea1" status: 200 len: 1513 microversion: 2.1 time: 0.153875 May 30 12:07:21.958129 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 222/456] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:07:21 2022] GET /compute/v2.1/servers/11600577-2336-4fdd-b0f0-78fbf42f8ea1 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:22.283077 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-67d90f76-44a2-4aad-bd2e-b58be6aae82d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:22.283685 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-67d90f76-44a2-4aad-bd2e-b58be6aae82d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:22.290265 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-67d90f76-44a2-4aad-bd2e-b58be6aae82d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:22.290712 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-67d90f76-44a2-4aad-bd2e-b58be6aae82d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:22.291473 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-67d90f76-44a2-4aad-bd2e-b58be6aae82d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:22.291908 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-67d90f76-44a2-4aad-bd2e-b58be6aae82d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:22.426454 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-67d90f76-44a2-4aad-bd2e-b58be6aae82d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:22.434840 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-67d90f76-44a2-4aad-bd2e-b58be6aae82d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:22.436394 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-67d90f76-44a2-4aad-bd2e-b58be6aae82d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:22.437559 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-67d90f76-44a2-4aad-bd2e-b58be6aae82d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1808 microversion: 2.20 time: 0.158915 May 30 12:07:22.438188 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 235/457] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:07:22 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:07:22.977444 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-84aca0fa-d10c-44ec-86b2-522321bbce9c tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:22.978082 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-84aca0fa-d10c-44ec-86b2-522321bbce9c tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] [instance: 11600577-2336-4fdd-b0f0-78fbf42f8ea1] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:22.985667 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-84aca0fa-d10c-44ec-86b2-522321bbce9c tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:22.986132 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-84aca0fa-d10c-44ec-86b2-522321bbce9c tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:22.986926 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-84aca0fa-d10c-44ec-86b2-522321bbce9c tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:22.987365 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-84aca0fa-d10c-44ec-86b2-522321bbce9c tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:23.036731 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-e0db053e-6ce0-4680-add8-a0c2482ca765 req-dd896a5c-ec85-440d-a91a-c2255ee7a09b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11600577-2336-4fdd-b0f0-78fbf42f8ea1", "name": "network-vif-deleted", "tag": "de5378e4-4146-4fbc-9827-83be39fbf054"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:07:23.045338 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-e0db053e-6ce0-4680-add8-a0c2482ca765 req-dd896a5c-ec85-440d-a91a-c2255ee7a09b service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:23.045864 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-e0db053e-6ce0-4680-add8-a0c2482ca765 req-dd896a5c-ec85-440d-a91a-c2255ee7a09b service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:23.055867 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-84aca0fa-d10c-44ec-86b2-522321bbce9c tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4c83a1ccfc43beb3f48e4462b06794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cd1e0377594f52bb5bfa7159731d48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:23.058487 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-e0db053e-6ce0-4680-add8-a0c2482ca765 req-dd896a5c-ec85-440d-a91a-c2255ee7a09b service nova] Creating event network-vif-deleted:de5378e4-4146-4fbc-9827-83be39fbf054 for instance 11600577-2336-4fdd-b0f0-78fbf42f8ea1 on hv-cinder-84051 May 30 12:07:23.064117 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-e0db053e-6ce0-4680-add8-a0c2482ca765 req-dd896a5c-ec85-440d-a91a-c2255ee7a09b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030509 May 30 12:07:23.065036 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 236/458] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:07:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 30 12:07:23.065672 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-84aca0fa-d10c-44ec-86b2-522321bbce9c tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] 10.222.0.32 "GET /compute/v2.1/servers/11600577-2336-4fdd-b0f0-78fbf42f8ea1" status: 200 len: 1471 microversion: 2.1 time: 0.094441 May 30 12:07:23.066266 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 223/459] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:07:22 2022] GET /compute/v2.1/servers/11600577-2336-4fdd-b0f0-78fbf42f8ea1 => generated 1471 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:23.456256 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-9dbfa6fc-ac1a-4e80-b850-710aeb07f11d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:23.457033 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-9dbfa6fc-ac1a-4e80-b850-710aeb07f11d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:23.463442 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9dbfa6fc-ac1a-4e80-b850-710aeb07f11d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:23.463892 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9dbfa6fc-ac1a-4e80-b850-710aeb07f11d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:23.464706 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9dbfa6fc-ac1a-4e80-b850-710aeb07f11d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:23.465147 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9dbfa6fc-ac1a-4e80-b850-710aeb07f11d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:23.602239 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-9dbfa6fc-ac1a-4e80-b850-710aeb07f11d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:23.612980 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-9dbfa6fc-ac1a-4e80-b850-710aeb07f11d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:23.614494 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-9dbfa6fc-ac1a-4e80-b850-710aeb07f11d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:23.615669 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-9dbfa6fc-ac1a-4e80-b850-710aeb07f11d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1808 microversion: 2.20 time: 0.164330 May 30 12:07:23.616446 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 237/460] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:07:23 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:07:24.083415 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-758d44bd-5ed4-41b3-85c7-062e14ad3bc1 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:24.084012 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-758d44bd-5ed4-41b3-85c7-062e14ad3bc1 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] [instance: 11600577-2336-4fdd-b0f0-78fbf42f8ea1] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:24.086342 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_api:SELECT=32 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:24.091665 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-758d44bd-5ed4-41b3-85c7-062e14ad3bc1 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:24.092114 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-758d44bd-5ed4-41b3-85c7-062e14ad3bc1 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:24.092902 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-758d44bd-5ed4-41b3-85c7-062e14ad3bc1 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:24.093338 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-758d44bd-5ed4-41b3-85c7-062e14ad3bc1 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:24.127923 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-758d44bd-5ed4-41b3-85c7-062e14ad3bc1 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:24.128394 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-758d44bd-5ed4-41b3-85c7-062e14ad3bc1 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:24.128847 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.objects.instance [None req-758d44bd-5ed4-41b3-85c7-062e14ad3bc1 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lazy-loading 'fault' on Instance uuid 11600577-2336-4fdd-b0f0-78fbf42f8ea1 {{(pid=117670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 30 12:07:24.170489 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-758d44bd-5ed4-41b3-85c7-062e14ad3bc1 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4c83a1ccfc43beb3f48e4462b06794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cd1e0377594f52bb5bfa7159731d48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:24.178245 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-758d44bd-5ed4-41b3-85c7-062e14ad3bc1 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] 10.222.0.32 "GET /compute/v2.1/servers/11600577-2336-4fdd-b0f0-78fbf42f8ea1" status: 200 len: 1308 microversion: 2.1 time: 0.098645 May 30 12:07:24.178824 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 224/461] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:07:24 2022] GET /compute/v2.1/servers/11600577-2336-4fdd-b0f0-78fbf42f8ea1 => generated 1308 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:24.633933 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-c32a2e1f-df57-40a4-babf-3d7217fdf60f tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:24.634667 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-c32a2e1f-df57-40a4-babf-3d7217fdf60f tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:24.640938 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c32a2e1f-df57-40a4-babf-3d7217fdf60f tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:24.641394 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c32a2e1f-df57-40a4-babf-3d7217fdf60f tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:24.642162 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c32a2e1f-df57-40a4-babf-3d7217fdf60f tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:24.642581 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c32a2e1f-df57-40a4-babf-3d7217fdf60f tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:24.777080 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-c32a2e1f-df57-40a4-babf-3d7217fdf60f tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:24.785674 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-c32a2e1f-df57-40a4-babf-3d7217fdf60f tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:24.787170 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-c32a2e1f-df57-40a4-babf-3d7217fdf60f tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:24.788487 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-c32a2e1f-df57-40a4-babf-3d7217fdf60f tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1808 microversion: 2.20 time: 0.158379 May 30 12:07:24.789211 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 238/462] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:07:24 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:07:25.196515 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-cd718dbf-2be5-41eb-b651-bf3612a1153f tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:25.197061 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-cd718dbf-2be5-41eb-b651-bf3612a1153f tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] [instance: 11600577-2336-4fdd-b0f0-78fbf42f8ea1] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:25.203465 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-cd718dbf-2be5-41eb-b651-bf3612a1153f tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:25.204036 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-cd718dbf-2be5-41eb-b651-bf3612a1153f tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:25.205055 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-cd718dbf-2be5-41eb-b651-bf3612a1153f tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:25.205484 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-cd718dbf-2be5-41eb-b651-bf3612a1153f tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:25.218680 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.wsgi [None req-cd718dbf-2be5-41eb-b651-bf3612a1153f tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] HTTP exception thrown: Instance 11600577-2336-4fdd-b0f0-78fbf42f8ea1 could not be found. May 30 12:07:25.221147 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-cd718dbf-2be5-41eb-b651-bf3612a1153f tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Request method failure captured: May 30 12:07:25.221147 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: request: GET /compute/v2.1/servers/11600577-2336-4fdd-b0f0-78fbf42f8ea1 HTTP/1.1 May 30 12:07:25.221147 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Accept: application/json May 30 12:07:25.221147 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Accept-Encoding: identity May 30 12:07:25.221147 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Connection: close May 30 12:07:25.221147 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Content-Length: 0 May 30 12:07:25.221147 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Content-Type: application/json May 30 12:07:25.221147 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Host: 10.222.0.32 May 30 12:07:25.221147 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Openstack-System-Scope: None May 30 12:07:25.221147 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: User-Agent: python-urllib3/1.26.9 May 30 12:07:25.221147 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Auth-Token: gAAAAABilLM0m5m8cr0UeAGDxFlkQLqhfCwYUzq4oH0C831uP9ByBJIelv18XA1AwqxgJ0rrfNfU-hxdXFP6_pRrxkFqJuQ1MzOQ4fyypIUOOZhdxzE9NUhguCBb9DNxEYfz9ndBB7H3RZrH2NQfkW2UtmGp2OHSj9poPwoAev7UW0JwXi30_Hs May 30 12:07:25.221147 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Domain-Id: None May 30 12:07:25.221147 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Domain-Name: None May 30 12:07:25.221147 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Identity-Status: Confirmed May 30 12:07:25.221147 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Is-Admin-Project: True May 30 12:07:25.221147 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Domain-Id: default May 30 12:07:25.221147 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Domain-Name: Default May 30 12:07:25.221147 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Id: 94cd1e0377594f52bb5bfa7159731d48 May 30 12:07:25.221147 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1260741086 May 30 12:07:25.221147 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Role: reader,member May 30 12:07:25.221147 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Roles: reader,member May 30 12:07:25.222809 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/94cd1e0377594f52bb5bfa7159731d48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/94cd1e0377594f52bb5bfa7159731d48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/94cd1e0377594f52bb5bfa7159731d48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_94cd1e0377594f52bb5bfa7159731d48", "adminURL": "http://10.222.0.32:8080"}]}] May 30 12:07:25.222809 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant: tempest-VolumesSnapshotTestJSON-1260741086 May 30 12:07:25.222809 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant-Id: 94cd1e0377594f52bb5bfa7159731d48 May 30 12:07:25.222809 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1260741086 May 30 12:07:25.222809 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User: tempest-VolumesSnapshotTestJSON-1260741086-project May 30 12:07:25.222809 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Domain-Id: default May 30 12:07:25.222809 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Domain-Name: Default May 30 12:07:25.222809 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Id: 1d4c83a1ccfc43beb3f48e4462b06794 May 30 12:07:25.222809 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Name: tempest-VolumesSnapshotTestJSON-1260741086-project May 30 12:07:25.222809 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: method: > May 30 12:07:25.222809 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: exception: Instance 11600577-2336-4fdd-b0f0-78fbf42f8ea1 could not be found. May 30 12:07:25.222809 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: action_args: {'id': '11600577-2336-4fdd-b0f0-78fbf42f8ea1'} May 30 12:07:25.223813 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:07:25.223813 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:07:25.223813 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:07:25.223813 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:07:25.223813 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:07:25.223813 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:07:25.223813 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:07:25.223813 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:07:25.223813 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:07:25.223813 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:07:25.223813 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11600577-2336-4fdd-b0f0-78fbf42f8ea1 could not be found. May 30 12:07:25.223813 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:07:25.223813 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:07:25.223813 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:07:25.223813 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:07:25.223813 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:07:25.223813 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:07:25.223813 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:07:25.223813 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:07:25.223813 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:07:25.225122 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:07:25.225122 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 30 12:07:25.225122 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 30 12:07:25.225122 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 30 12:07:25.225122 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 30 12:07:25.225122 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:07:25.225122 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:07:25.225122 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11600577-2336-4fdd-b0f0-78fbf42f8ea1 could not be found. May 30 12:07:25.225122 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:07:25.225122 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:07:25.225122 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:07:25.225122 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:07:25.225122 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:07:25.225122 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:07:25.225122 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:07:25.225122 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:07:25.225122 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11600577-2336-4fdd-b0f0-78fbf42f8ea1 could not be found. May 30 12:07:25.225122 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:07:25.226210 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-cd718dbf-2be5-41eb-b651-bf3612a1153f tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Returning 404 to user: Instance 11600577-2336-4fdd-b0f0-78fbf42f8ea1 could not be found. {{(pid=117670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:07:25.226210 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-cd718dbf-2be5-41eb-b651-bf3612a1153f tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] 10.222.0.32 "GET /compute/v2.1/servers/11600577-2336-4fdd-b0f0-78fbf42f8ea1" status: 404 len: 111 microversion: 2.1 time: 0.030016 May 30 12:07:25.226210 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 225/463] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:07:25 2022] GET /compute/v2.1/servers/11600577-2336-4fdd-b0f0-78fbf42f8ea1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 30 12:07:25.807814 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-d6102a59-c3ba-4808-89a9-7f794bebbde9 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:25.808476 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-d6102a59-c3ba-4808-89a9-7f794bebbde9 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:25.815815 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d6102a59-c3ba-4808-89a9-7f794bebbde9 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:25.816284 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d6102a59-c3ba-4808-89a9-7f794bebbde9 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:25.817090 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d6102a59-c3ba-4808-89a9-7f794bebbde9 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:25.817526 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d6102a59-c3ba-4808-89a9-7f794bebbde9 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:25.958647 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-d6102a59-c3ba-4808-89a9-7f794bebbde9 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:25.967047 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-d6102a59-c3ba-4808-89a9-7f794bebbde9 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:25.968617 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-d6102a59-c3ba-4808-89a9-7f794bebbde9 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:25.969783 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-d6102a59-c3ba-4808-89a9-7f794bebbde9 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1808 microversion: 2.20 time: 0.166111 May 30 12:07:25.970477 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 239/464] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:07:25 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:07:26.989498 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-15c9a4e7-42af-4b1d-8f28-5b1bc3ff7fc5 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:26.990102 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-15c9a4e7-42af-4b1d-8f28-5b1bc3ff7fc5 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:26.997815 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-15c9a4e7-42af-4b1d-8f28-5b1bc3ff7fc5 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:26.998479 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-15c9a4e7-42af-4b1d-8f28-5b1bc3ff7fc5 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:26.999276 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-15c9a4e7-42af-4b1d-8f28-5b1bc3ff7fc5 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:26.999706 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-15c9a4e7-42af-4b1d-8f28-5b1bc3ff7fc5 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:27.132686 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-15c9a4e7-42af-4b1d-8f28-5b1bc3ff7fc5 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:27.141543 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-15c9a4e7-42af-4b1d-8f28-5b1bc3ff7fc5 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:27.143520 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-15c9a4e7-42af-4b1d-8f28-5b1bc3ff7fc5 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:27.145214 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-15c9a4e7-42af-4b1d-8f28-5b1bc3ff7fc5 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1808 microversion: 2.20 time: 0.160872 May 30 12:07:27.145781 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 226/465] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:07:26 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 30 12:07:28.163852 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-d8671374-4b1f-4316-b345-5159386dc0a3 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:28.164768 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-d8671374-4b1f-4316-b345-5159386dc0a3 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:28.171194 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d8671374-4b1f-4316-b345-5159386dc0a3 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:28.171640 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d8671374-4b1f-4316-b345-5159386dc0a3 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:28.172449 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d8671374-4b1f-4316-b345-5159386dc0a3 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:28.172878 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d8671374-4b1f-4316-b345-5159386dc0a3 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:28.304602 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-d8671374-4b1f-4316-b345-5159386dc0a3 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:28.312958 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-d8671374-4b1f-4316-b345-5159386dc0a3 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:28.314474 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-d8671374-4b1f-4316-b345-5159386dc0a3 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:28.315745 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-d8671374-4b1f-4316-b345-5159386dc0a3 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1808 microversion: 2.20 time: 0.156093 May 30 12:07:28.316317 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 240/466] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:07:28 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:07:29.334438 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-8d895a03-3459-4a97-b65f-a7e17cdfb990 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:29.335228 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-8d895a03-3459-4a97-b65f-a7e17cdfb990 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:29.342903 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8d895a03-3459-4a97-b65f-a7e17cdfb990 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:29.343462 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8d895a03-3459-4a97-b65f-a7e17cdfb990 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:29.344262 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8d895a03-3459-4a97-b65f-a7e17cdfb990 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:29.344698 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8d895a03-3459-4a97-b65f-a7e17cdfb990 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:29.477781 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-8d895a03-3459-4a97-b65f-a7e17cdfb990 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:29.486251 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-8d895a03-3459-4a97-b65f-a7e17cdfb990 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:29.488051 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-8d895a03-3459-4a97-b65f-a7e17cdfb990 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:29.489245 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-8d895a03-3459-4a97-b65f-a7e17cdfb990 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1808 microversion: 2.20 time: 0.159755 May 30 12:07:29.489803 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 227/467] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:07:29 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:07:29.816148 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 30 12:07:29.816579 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Mon May 30 12:07:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 30 12:07:30.507581 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-7a49fa2a-60a2-4da0-a58e-8304ca5432be tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:30.508205 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-7a49fa2a-60a2-4da0-a58e-8304ca5432be tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:30.514830 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7a49fa2a-60a2-4da0-a58e-8304ca5432be tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:30.515270 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7a49fa2a-60a2-4da0-a58e-8304ca5432be tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:30.516041 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7a49fa2a-60a2-4da0-a58e-8304ca5432be tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:30.516505 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7a49fa2a-60a2-4da0-a58e-8304ca5432be tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:30.558512 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-dc10efdd-8d35-4576-ad10-b4a8cf46b9bd req-b7c0f330-73af-44ef-afa8-cf0debbcc721 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "314658c0-2ad4-4987-99bc-f8acf2d7e46c", "name": "network-vif-plugged", "status": "completed", "tag": "66de87a6-f3b1-41fb-8926-85240efcbe51"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:07:30.569617 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-dc10efdd-8d35-4576-ad10-b4a8cf46b9bd req-b7c0f330-73af-44ef-afa8-cf0debbcc721 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:30.570290 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-dc10efdd-8d35-4576-ad10-b4a8cf46b9bd req-b7c0f330-73af-44ef-afa8-cf0debbcc721 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:30.581511 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-dc10efdd-8d35-4576-ad10-b4a8cf46b9bd req-b7c0f330-73af-44ef-afa8-cf0debbcc721 service nova] Creating event network-vif-plugged:66de87a6-f3b1-41fb-8926-85240efcbe51 for instance 314658c0-2ad4-4987-99bc-f8acf2d7e46c on hv-cinder-84051 May 30 12:07:30.586706 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-dc10efdd-8d35-4576-ad10-b4a8cf46b9bd req-b7c0f330-73af-44ef-afa8-cf0debbcc721 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032956 May 30 12:07:30.587853 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 228/468] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:07:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:07:30.660598 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-7a49fa2a-60a2-4da0-a58e-8304ca5432be tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:30.669146 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-7a49fa2a-60a2-4da0-a58e-8304ca5432be tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:30.670647 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-7a49fa2a-60a2-4da0-a58e-8304ca5432be tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:30.671807 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-7a49fa2a-60a2-4da0-a58e-8304ca5432be tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1808 microversion: 2.20 time: 0.168302 May 30 12:07:30.672401 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 241/469] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:07:30 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:07:31.692314 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-1c82603f-f2f8-4045-8885-3bae7fbd093c tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:31.693008 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-1c82603f-f2f8-4045-8885-3bae7fbd093c tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:31.699216 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1c82603f-f2f8-4045-8885-3bae7fbd093c tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:31.699664 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1c82603f-f2f8-4045-8885-3bae7fbd093c tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:31.700460 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1c82603f-f2f8-4045-8885-3bae7fbd093c tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:31.700900 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1c82603f-f2f8-4045-8885-3bae7fbd093c tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:31.833077 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-1c82603f-f2f8-4045-8885-3bae7fbd093c tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:31.841986 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-1c82603f-f2f8-4045-8885-3bae7fbd093c tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:31.843606 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-1c82603f-f2f8-4045-8885-3bae7fbd093c tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:31.844865 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-1c82603f-f2f8-4045-8885-3bae7fbd093c tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1808 microversion: 2.20 time: 0.157842 May 30 12:07:31.845419 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 229/470] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:07:31 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:07:32.864713 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-cc79129d-d5a3-409a-a59a-fb9b9371cbbc tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:32.865268 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-cc79129d-d5a3-409a-a59a-fb9b9371cbbc tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:32.871932 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-cc79129d-d5a3-409a-a59a-fb9b9371cbbc tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:32.872426 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-cc79129d-d5a3-409a-a59a-fb9b9371cbbc tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:32.873197 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-cc79129d-d5a3-409a-a59a-fb9b9371cbbc tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:32.873636 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-cc79129d-d5a3-409a-a59a-fb9b9371cbbc tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:33.006361 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-cc79129d-d5a3-409a-a59a-fb9b9371cbbc tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:33.015565 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-cc79129d-d5a3-409a-a59a-fb9b9371cbbc tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:33.017141 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-cc79129d-d5a3-409a-a59a-fb9b9371cbbc tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:33.018326 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-cc79129d-d5a3-409a-a59a-fb9b9371cbbc tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1808 microversion: 2.20 time: 0.157764 May 30 12:07:33.019503 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 242/471] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:07:32 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:07:34.047341 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-cf7f9276-5e8e-40b2-87c5-f88ee601d793 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:34.047953 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-cf7f9276-5e8e-40b2-87c5-f88ee601d793 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:34.055080 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-cf7f9276-5e8e-40b2-87c5-f88ee601d793 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:34.055532 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-cf7f9276-5e8e-40b2-87c5-f88ee601d793 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:34.056340 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-cf7f9276-5e8e-40b2-87c5-f88ee601d793 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:34.056782 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-cf7f9276-5e8e-40b2-87c5-f88ee601d793 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:34.090911 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-dc737708-b5b5-4d3e-bac5-f8e75dab7024 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-82332631", "imageRef": "b8ef93ed-af98-4d8c-9e1d-43d7b1f2b832", "flavorRef": "452", "networks": [{"uuid": "74823171-a713-4723-823f-3ac14207cc72"}]}} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:07:34.144642 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.network.neutron [None req-dc737708-b5b5-4d3e-bac5-f8e75dab7024 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] validate_networks() for [('74823171-a713-4723-823f-3ac14207cc72', None, None, None, None, None)] {{(pid=117671) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 30 12:07:34.251376 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-cf7f9276-5e8e-40b2-87c5-f88ee601d793 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:34.259871 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-cf7f9276-5e8e-40b2-87c5-f88ee601d793 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:34.261526 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-cf7f9276-5e8e-40b2-87c5-f88ee601d793 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:34.262812 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-cf7f9276-5e8e-40b2-87c5-f88ee601d793 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1808 microversion: 2.20 time: 0.219366 May 30 12:07:34.263449 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 230/472] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:07:34 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1808 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:07:34.527277 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-dc737708-b5b5-4d3e-bac5-f8e75dab7024 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Flavor limits 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 30 12:07:34.527694 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-dc737708-b5b5-4d3e-bac5-f8e75dab7024 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Image limits 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 30 12:07:34.528180 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-dc737708-b5b5-4d3e-bac5-f8e75dab7024 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Flavor pref 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 30 12:07:34.528594 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-dc737708-b5b5-4d3e-bac5-f8e75dab7024 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Image pref 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 30 12:07:34.528999 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-dc737708-b5b5-4d3e-bac5-f8e75dab7024 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 30 12:07:34.538755 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-dc737708-b5b5-4d3e-bac5-f8e75dab7024 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:34.539195 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-dc737708-b5b5-4d3e-bac5-f8e75dab7024 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:34.539986 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-dc737708-b5b5-4d3e-bac5-f8e75dab7024 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:34.540460 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-dc737708-b5b5-4d3e-bac5-f8e75dab7024 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:34.556852 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.quota [None req-dc737708-b5b5-4d3e-bac5-f8e75dab7024 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Getting quotas for project 94cd1e0377594f52bb5bfa7159731d48. Resources: {'cores', 'instances', 'ram'} {{(pid=117671) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 30 12:07:34.561038 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.quota [None req-dc737708-b5b5-4d3e-bac5-f8e75dab7024 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Getting quotas for user 1d4c83a1ccfc43beb3f48e4462b06794 and project 94cd1e0377594f52bb5bfa7159731d48. Resources: {'cores', 'instances', 'ram'} {{(pid=117671) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 30 12:07:34.572452 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-dc737708-b5b5-4d3e-bac5-f8e75dab7024 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Going to run 1 instances... {{(pid=117671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 30 12:07:34.574722 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-dc737708-b5b5-4d3e-bac5-f8e75dab7024 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] [instance: f99a1e0b-a450-43f6-82ca-32c64eac21b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b8ef93ed-af98-4d8c-9e1d-43d7b1f2b832',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 30 12:07:34.622411 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-dc737708-b5b5-4d3e-bac5-f8e75dab7024 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.535189 May 30 12:07:34.623042 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 243/473] 10.222.0.32 () {60 vars in 1146 bytes} [Mon May 30 12:07:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 536 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 30 12:07:34.633604 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-5cb79400-29b4-4c4c-a86f-6823c2852d66 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:34.634254 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-5cb79400-29b4-4c4c-a86f-6823c2852d66 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] [instance: f99a1e0b-a450-43f6-82ca-32c64eac21b4] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:34.690150 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-5cb79400-29b4-4c4c-a86f-6823c2852d66 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4c83a1ccfc43beb3f48e4462b06794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cd1e0377594f52bb5bfa7159731d48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:34.698070 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-5cb79400-29b4-4c4c-a86f-6823c2852d66 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] 10.222.0.32 "GET /compute/v2.1/servers/f99a1e0b-a450-43f6-82ca-32c64eac21b4" status: 200 len: 1217 microversion: 2.1 time: 0.068324 May 30 12:07:34.698659 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 231/474] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:07:34 2022] GET /compute/v2.1/servers/f99a1e0b-a450-43f6-82ca-32c64eac21b4 => generated 1217 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:35.282438 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-1390e1ee-8f32-4ed5-8db9-26602c9c4410 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:35.283079 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-1390e1ee-8f32-4ed5-8db9-26602c9c4410 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:35.289349 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1390e1ee-8f32-4ed5-8db9-26602c9c4410 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:35.289796 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1390e1ee-8f32-4ed5-8db9-26602c9c4410 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:35.290571 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1390e1ee-8f32-4ed5-8db9-26602c9c4410 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:35.291007 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1390e1ee-8f32-4ed5-8db9-26602c9c4410 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:35.293765 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:35.426619 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-1390e1ee-8f32-4ed5-8db9-26602c9c4410 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:35.435267 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-1390e1ee-8f32-4ed5-8db9-26602c9c4410 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:35.436805 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-1390e1ee-8f32-4ed5-8db9-26602c9c4410 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:35.437965 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-1390e1ee-8f32-4ed5-8db9-26602c9c4410 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1808 microversion: 2.20 time: 0.160031 May 30 12:07:35.438518 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 244/475] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:07:35 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:07:35.715653 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-a29a71ae-2fc6-401c-8040-4c2204880d15 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:35.716338 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-a29a71ae-2fc6-401c-8040-4c2204880d15 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] [instance: f99a1e0b-a450-43f6-82ca-32c64eac21b4] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:35.724737 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a29a71ae-2fc6-401c-8040-4c2204880d15 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:35.725194 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a29a71ae-2fc6-401c-8040-4c2204880d15 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:35.725995 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a29a71ae-2fc6-401c-8040-4c2204880d15 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:35.726441 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a29a71ae-2fc6-401c-8040-4c2204880d15 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:35.801290 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-a29a71ae-2fc6-401c-8040-4c2204880d15 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4c83a1ccfc43beb3f48e4462b06794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cd1e0377594f52bb5bfa7159731d48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:35.809133 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-a29a71ae-2fc6-401c-8040-4c2204880d15 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] 10.222.0.32 "GET /compute/v2.1/servers/f99a1e0b-a450-43f6-82ca-32c64eac21b4" status: 200 len: 1269 microversion: 2.1 time: 0.097366 May 30 12:07:35.809797 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 232/476] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:07:35 2022] GET /compute/v2.1/servers/f99a1e0b-a450-43f6-82ca-32c64eac21b4 => generated 1269 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:36.457004 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-378e2ef3-ddea-4dd8-a144-c481ff91db60 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:36.458753 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-378e2ef3-ddea-4dd8-a144-c481ff91db60 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:36.465371 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-378e2ef3-ddea-4dd8-a144-c481ff91db60 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:36.465821 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-378e2ef3-ddea-4dd8-a144-c481ff91db60 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:36.466589 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-378e2ef3-ddea-4dd8-a144-c481ff91db60 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:36.467204 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-378e2ef3-ddea-4dd8-a144-c481ff91db60 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:36.614595 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-378e2ef3-ddea-4dd8-a144-c481ff91db60 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:36.624051 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-378e2ef3-ddea-4dd8-a144-c481ff91db60 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:36.625654 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-378e2ef3-ddea-4dd8-a144-c481ff91db60 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:36.626884 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-378e2ef3-ddea-4dd8-a144-c481ff91db60 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1795 microversion: 2.20 time: 0.174806 May 30 12:07:36.627458 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 245/477] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:07:36 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1795 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:07:36.827114 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-29b1970e-9108-49ff-9c9d-245aa48cbe3e tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:36.827957 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-29b1970e-9108-49ff-9c9d-245aa48cbe3e tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] [instance: f99a1e0b-a450-43f6-82ca-32c64eac21b4] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:36.836486 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-29b1970e-9108-49ff-9c9d-245aa48cbe3e tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:36.836967 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-29b1970e-9108-49ff-9c9d-245aa48cbe3e tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:36.838033 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-29b1970e-9108-49ff-9c9d-245aa48cbe3e tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:36.838577 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-29b1970e-9108-49ff-9c9d-245aa48cbe3e tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:36.976070 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-29b1970e-9108-49ff-9c9d-245aa48cbe3e tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4c83a1ccfc43beb3f48e4462b06794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cd1e0377594f52bb5bfa7159731d48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:36.983607 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-29b1970e-9108-49ff-9c9d-245aa48cbe3e tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] 10.222.0.32 "GET /compute/v2.1/servers/f99a1e0b-a450-43f6-82ca-32c64eac21b4" status: 200 len: 1317 microversion: 2.1 time: 0.160455 May 30 12:07:36.984205 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 233/478] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:07:36 2022] GET /compute/v2.1/servers/f99a1e0b-a450-43f6-82ca-32c64eac21b4 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:37.455086 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-62c500c2-21ad-4309-8e62-4de64f9345ef req-dbec9d1f-4e0c-4424-8b6f-de026d8cfead service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f99a1e0b-a450-43f6-82ca-32c64eac21b4", "tag": "0f672e22-24fe-42e6-ad6b-9c60ec54b09e"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:07:37.467834 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-62c500c2-21ad-4309-8e62-4de64f9345ef req-dbec9d1f-4e0c-4424-8b6f-de026d8cfead service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:37.468466 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-62c500c2-21ad-4309-8e62-4de64f9345ef req-dbec9d1f-4e0c-4424-8b6f-de026d8cfead service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:37.485720 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-62c500c2-21ad-4309-8e62-4de64f9345ef req-dbec9d1f-4e0c-4424-8b6f-de026d8cfead service nova] Creating event network-changed:0f672e22-24fe-42e6-ad6b-9c60ec54b09e for instance f99a1e0b-a450-43f6-82ca-32c64eac21b4 on hv-cinder-84051 May 30 12:07:37.491808 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-62c500c2-21ad-4309-8e62-4de64f9345ef req-dbec9d1f-4e0c-4424-8b6f-de026d8cfead service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040368 May 30 12:07:37.492435 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 246/479] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:07:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:07:38.001247 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-fbbb6c8a-0c3f-41ba-b8d6-341e6c642f8c tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:38.001866 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-fbbb6c8a-0c3f-41ba-b8d6-341e6c642f8c tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] [instance: f99a1e0b-a450-43f6-82ca-32c64eac21b4] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:38.009038 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-fbbb6c8a-0c3f-41ba-b8d6-341e6c642f8c tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:38.009485 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-fbbb6c8a-0c3f-41ba-b8d6-341e6c642f8c tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:38.010252 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-fbbb6c8a-0c3f-41ba-b8d6-341e6c642f8c tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:38.010685 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-fbbb6c8a-0c3f-41ba-b8d6-341e6c642f8c tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:38.142613 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-fbbb6c8a-0c3f-41ba-b8d6-341e6c642f8c tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4c83a1ccfc43beb3f48e4462b06794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cd1e0377594f52bb5bfa7159731d48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:38.150320 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-fbbb6c8a-0c3f-41ba-b8d6-341e6c642f8c tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] 10.222.0.32 "GET /compute/v2.1/servers/f99a1e0b-a450-43f6-82ca-32c64eac21b4" status: 200 len: 1317 microversion: 2.1 time: 0.152947 May 30 12:07:38.150883 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 234/480] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:07:37 2022] GET /compute/v2.1/servers/f99a1e0b-a450-43f6-82ca-32c64eac21b4 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:07:39.168637 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-b809ea0a-efd3-4e22-a654-da6fcbbf1aa1 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:39.169204 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-b809ea0a-efd3-4e22-a654-da6fcbbf1aa1 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] [instance: f99a1e0b-a450-43f6-82ca-32c64eac21b4] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:39.175282 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b809ea0a-efd3-4e22-a654-da6fcbbf1aa1 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:39.175732 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b809ea0a-efd3-4e22-a654-da6fcbbf1aa1 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:39.176518 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b809ea0a-efd3-4e22-a654-da6fcbbf1aa1 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:39.176948 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b809ea0a-efd3-4e22-a654-da6fcbbf1aa1 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:39.311957 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-b809ea0a-efd3-4e22-a654-da6fcbbf1aa1 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4c83a1ccfc43beb3f48e4462b06794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cd1e0377594f52bb5bfa7159731d48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:39.320146 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-b809ea0a-efd3-4e22-a654-da6fcbbf1aa1 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] 10.222.0.32 "GET /compute/v2.1/servers/f99a1e0b-a450-43f6-82ca-32c64eac21b4" status: 200 len: 1317 microversion: 2.1 time: 0.156712 May 30 12:07:39.320760 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 247/481] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:07:39 2022] GET /compute/v2.1/servers/f99a1e0b-a450-43f6-82ca-32c64eac21b4 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:40.337914 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-215fa7ad-5c76-4c7c-857f-8d7a039d384b tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:40.338565 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-215fa7ad-5c76-4c7c-857f-8d7a039d384b tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] [instance: f99a1e0b-a450-43f6-82ca-32c64eac21b4] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:40.345115 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-215fa7ad-5c76-4c7c-857f-8d7a039d384b tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:40.345566 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-215fa7ad-5c76-4c7c-857f-8d7a039d384b tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:40.346336 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-215fa7ad-5c76-4c7c-857f-8d7a039d384b tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:40.346785 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-215fa7ad-5c76-4c7c-857f-8d7a039d384b tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:40.389965 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-c9dcc583-7aeb-439e-9482-46c4beb7f984 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:40.390553 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-c9dcc583-7aeb-439e-9482-46c4beb7f984 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 08b1b860-516e-4041-8df8-1fa8cc65a4ed] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:40.397515 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c9dcc583-7aeb-439e-9482-46c4beb7f984 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:40.397969 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c9dcc583-7aeb-439e-9482-46c4beb7f984 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:40.399517 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c9dcc583-7aeb-439e-9482-46c4beb7f984 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:40.399935 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c9dcc583-7aeb-439e-9482-46c4beb7f984 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:40.487912 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-215fa7ad-5c76-4c7c-857f-8d7a039d384b tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4c83a1ccfc43beb3f48e4462b06794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cd1e0377594f52bb5bfa7159731d48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:40.496275 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-215fa7ad-5c76-4c7c-857f-8d7a039d384b tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] 10.222.0.32 "GET /compute/v2.1/servers/f99a1e0b-a450-43f6-82ca-32c64eac21b4" status: 200 len: 1317 microversion: 2.1 time: 0.162892 May 30 12:07:40.505761 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 235/482] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:07:40 2022] GET /compute/v2.1/servers/f99a1e0b-a450-43f6-82ca-32c64eac21b4 => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:40.535303 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.objects.instance [None req-c9dcc583-7aeb-439e-9482-46c4beb7f984 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lazy-loading 'services' on Instance uuid 08b1b860-516e-4041-8df8-1fa8cc65a4ed {{(pid=117671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 30 12:07:40.655389 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-c9dcc583-7aeb-439e-9482-46c4beb7f984 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "DELETE /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed/os-volume_attachments/6b957e5c-871c-4a09-aa09-04b2b9efb383" status: 202 len: 0 microversion: 2.1 time: 0.269197 May 30 12:07:40.655987 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 248/483] 10.222.0.32 () {58 vars in 1415 bytes} [Mon May 30 12:07:40 2022] DELETE /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed/os-volume_attachments/6b957e5c-871c-4a09-aa09-04b2b9efb383 => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 30 12:07:41.512802 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-ce1dbeee-9054-480a-b856-d14527c942db tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:41.513439 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-ce1dbeee-9054-480a-b856-d14527c942db tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] [instance: f99a1e0b-a450-43f6-82ca-32c64eac21b4] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:41.520410 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ce1dbeee-9054-480a-b856-d14527c942db tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:41.520853 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ce1dbeee-9054-480a-b856-d14527c942db tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:41.521618 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ce1dbeee-9054-480a-b856-d14527c942db tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:41.522040 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ce1dbeee-9054-480a-b856-d14527c942db tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:41.670996 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-ce1dbeee-9054-480a-b856-d14527c942db tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4c83a1ccfc43beb3f48e4462b06794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cd1e0377594f52bb5bfa7159731d48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:41.679399 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-ce1dbeee-9054-480a-b856-d14527c942db tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] 10.222.0.32 "GET /compute/v2.1/servers/f99a1e0b-a450-43f6-82ca-32c64eac21b4" status: 200 len: 1317 microversion: 2.1 time: 0.170950 May 30 12:07:41.680605 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 236/484] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:07:41 2022] GET /compute/v2.1/servers/f99a1e0b-a450-43f6-82ca-32c64eac21b4 => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:41.785562 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-57c55934-7e2d-43c4-b404-8ab246373803 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:07:41.792653 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-57c55934-7e2d-43c4-b404-8ab246373803 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:41.793103 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-57c55934-7e2d-43c4-b404-8ab246373803 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:41.816305 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-57c55934-7e2d-43c4-b404-8ab246373803 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 08b1b860-516e-4041-8df8-1fa8cc65a4ed] Going to try to stop instance {{(pid=117671) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 30 12:07:41.858229 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-57c55934-7e2d-43c4-b404-8ab246373803 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "POST /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed/action" status: 202 len: 0 microversion: 2.1 time: 0.077181 May 30 12:07:41.858864 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 249/485] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 30 12:07:41 2022] POST /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 30 12:07:41.866869 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-f0afbd0c-10c5-406c-9969-bde12e027805 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:41.868390 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-f0afbd0c-10c5-406c-9969-bde12e027805 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 08b1b860-516e-4041-8df8-1fa8cc65a4ed] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:41.875224 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f0afbd0c-10c5-406c-9969-bde12e027805 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:41.875727 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f0afbd0c-10c5-406c-9969-bde12e027805 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:41.876483 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f0afbd0c-10c5-406c-9969-bde12e027805 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:41.876912 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f0afbd0c-10c5-406c-9969-bde12e027805 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:42.010294 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-f0afbd0c-10c5-406c-9969-bde12e027805 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76e8d7bfdc04ea79c83ca7fb6b9ade1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5074cf3e6248668995f266845c8969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:42.017878 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-f0afbd0c-10c5-406c-9969-bde12e027805 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed" status: 200 len: 1677 microversion: 2.1 time: 0.154828 May 30 12:07:42.018441 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 237/486] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:07:41 2022] GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:42.638244 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-fd39e4ca-a3ff-4322-bcae-0f4eb24d99b8 req-f5f700fe-2c12-4737-b81e-881003fdc89e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f99a1e0b-a450-43f6-82ca-32c64eac21b4", "name": "network-vif-plugged", "status": "completed", "tag": "0f672e22-24fe-42e6-ad6b-9c60ec54b09e"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:07:42.647147 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-fd39e4ca-a3ff-4322-bcae-0f4eb24d99b8 req-f5f700fe-2c12-4737-b81e-881003fdc89e service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:42.647570 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-fd39e4ca-a3ff-4322-bcae-0f4eb24d99b8 req-f5f700fe-2c12-4737-b81e-881003fdc89e service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:42.660133 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-fd39e4ca-a3ff-4322-bcae-0f4eb24d99b8 req-f5f700fe-2c12-4737-b81e-881003fdc89e service nova] Creating event network-vif-plugged:0f672e22-24fe-42e6-ad6b-9c60ec54b09e for instance f99a1e0b-a450-43f6-82ca-32c64eac21b4 on hv-cinder-84051 May 30 12:07:42.665485 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-fd39e4ca-a3ff-4322-bcae-0f4eb24d99b8 req-f5f700fe-2c12-4737-b81e-881003fdc89e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031617 May 30 12:07:42.666081 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 250/487] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:07:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:07:42.702412 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-b0076668-5926-4a81-8fd5-63710602f3ac tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:42.703120 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-b0076668-5926-4a81-8fd5-63710602f3ac tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] [instance: f99a1e0b-a450-43f6-82ca-32c64eac21b4] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:42.710531 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b0076668-5926-4a81-8fd5-63710602f3ac tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:42.711699 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b0076668-5926-4a81-8fd5-63710602f3ac tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:42.712821 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b0076668-5926-4a81-8fd5-63710602f3ac tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:42.713254 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b0076668-5926-4a81-8fd5-63710602f3ac tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:42.863007 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-b0076668-5926-4a81-8fd5-63710602f3ac tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4c83a1ccfc43beb3f48e4462b06794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cd1e0377594f52bb5bfa7159731d48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:42.872229 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-b0076668-5926-4a81-8fd5-63710602f3ac tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] 10.222.0.32 "GET /compute/v2.1/servers/f99a1e0b-a450-43f6-82ca-32c64eac21b4" status: 200 len: 1317 microversion: 2.1 time: 0.175501 May 30 12:07:42.872920 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 238/488] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:07:42 2022] GET /compute/v2.1/servers/f99a1e0b-a450-43f6-82ca-32c64eac21b4 => generated 1317 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:43.037302 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-a3749c40-dd6d-4b74-9d4f-24c0e27ef2fc tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:43.038001 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-a3749c40-dd6d-4b74-9d4f-24c0e27ef2fc tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 08b1b860-516e-4041-8df8-1fa8cc65a4ed] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:43.040031 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:43.045784 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a3749c40-dd6d-4b74-9d4f-24c0e27ef2fc tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:43.046242 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a3749c40-dd6d-4b74-9d4f-24c0e27ef2fc tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:43.047012 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a3749c40-dd6d-4b74-9d4f-24c0e27ef2fc tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:43.047449 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a3749c40-dd6d-4b74-9d4f-24c0e27ef2fc tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:43.180219 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-a3749c40-dd6d-4b74-9d4f-24c0e27ef2fc tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76e8d7bfdc04ea79c83ca7fb6b9ade1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5074cf3e6248668995f266845c8969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:43.187732 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-a3749c40-dd6d-4b74-9d4f-24c0e27ef2fc tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed" status: 200 len: 1677 microversion: 2.1 time: 0.155227 May 30 12:07:43.188392 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 251/489] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:07:43 2022] GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:43.890050 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-83fd2754-8bf8-4031-bdf8-336553964647 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:43.890628 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-83fd2754-8bf8-4031-bdf8-336553964647 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] [instance: f99a1e0b-a450-43f6-82ca-32c64eac21b4] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:43.897316 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-83fd2754-8bf8-4031-bdf8-336553964647 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:43.897766 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-83fd2754-8bf8-4031-bdf8-336553964647 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:43.899219 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-83fd2754-8bf8-4031-bdf8-336553964647 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:43.899653 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-83fd2754-8bf8-4031-bdf8-336553964647 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:44.030855 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-83fd2754-8bf8-4031-bdf8-336553964647 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4c83a1ccfc43beb3f48e4462b06794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cd1e0377594f52bb5bfa7159731d48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:44.038365 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-83fd2754-8bf8-4031-bdf8-336553964647 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] 10.222.0.32 "GET /compute/v2.1/servers/f99a1e0b-a450-43f6-82ca-32c64eac21b4" status: 200 len: 1317 microversion: 2.1 time: 0.152269 May 30 12:07:44.039020 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 239/490] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:07:43 2022] GET /compute/v2.1/servers/f99a1e0b-a450-43f6-82ca-32c64eac21b4 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:44.205631 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-42fbb8c9-8692-45c1-93ba-c1aed0db5057 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:44.206167 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-42fbb8c9-8692-45c1-93ba-c1aed0db5057 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 08b1b860-516e-4041-8df8-1fa8cc65a4ed] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:44.214118 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-42fbb8c9-8692-45c1-93ba-c1aed0db5057 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:44.214607 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-42fbb8c9-8692-45c1-93ba-c1aed0db5057 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:44.215387 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-42fbb8c9-8692-45c1-93ba-c1aed0db5057 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:44.215825 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-42fbb8c9-8692-45c1-93ba-c1aed0db5057 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:44.345516 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-42fbb8c9-8692-45c1-93ba-c1aed0db5057 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76e8d7bfdc04ea79c83ca7fb6b9ade1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5074cf3e6248668995f266845c8969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:44.353353 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-42fbb8c9-8692-45c1-93ba-c1aed0db5057 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed" status: 200 len: 1677 microversion: 2.1 time: 0.151619 May 30 12:07:44.353922 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 252/491] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:07:44 2022] GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:45.055284 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-17083209-f17a-48e6-b228-591fa0994ff5 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:45.056222 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-17083209-f17a-48e6-b228-591fa0994ff5 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] [instance: f99a1e0b-a450-43f6-82ca-32c64eac21b4] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:45.058900 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell0:SELECT=2 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:45.067520 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-17083209-f17a-48e6-b228-591fa0994ff5 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:45.067972 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-17083209-f17a-48e6-b228-591fa0994ff5 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:45.068792 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-17083209-f17a-48e6-b228-591fa0994ff5 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:45.069231 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-17083209-f17a-48e6-b228-591fa0994ff5 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:45.201106 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-17083209-f17a-48e6-b228-591fa0994ff5 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4c83a1ccfc43beb3f48e4462b06794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cd1e0377594f52bb5bfa7159731d48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:45.204533 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell1:SELECT=100 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:45.209500 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-17083209-f17a-48e6-b228-591fa0994ff5 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] 10.222.0.32 "GET /compute/v2.1/servers/f99a1e0b-a450-43f6-82ca-32c64eac21b4" status: 200 len: 1507 microversion: 2.1 time: 0.158159 May 30 12:07:45.210062 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 240/492] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:07:45 2022] GET /compute/v2.1/servers/f99a1e0b-a450-43f6-82ca-32c64eac21b4 => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:45.226996 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-f064a098-ae24-49de-a09c-dee0525a91d0 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "134e879e-6551-4583-bc8c-88ac901b5526", "device": "/dev/sdb"}} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:07:45.228664 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-f064a098-ae24-49de-a09c-dee0525a91d0 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] [instance: f99a1e0b-a450-43f6-82ca-32c64eac21b4] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:45.230594 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell0:SELECT=2 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:45.231258 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell0:SELECT=6 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:45.237750 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f064a098-ae24-49de-a09c-dee0525a91d0 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:45.238202 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f064a098-ae24-49de-a09c-dee0525a91d0 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:45.238973 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f064a098-ae24-49de-a09c-dee0525a91d0 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:45.239409 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f064a098-ae24-49de-a09c-dee0525a91d0 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:45.371634 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-3ef8cc1f-7fcf-446b-8bd3-9dad2d4444a9 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:45.372310 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-3ef8cc1f-7fcf-446b-8bd3-9dad2d4444a9 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 08b1b860-516e-4041-8df8-1fa8cc65a4ed] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:45.379346 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3ef8cc1f-7fcf-446b-8bd3-9dad2d4444a9 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:45.385989 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3ef8cc1f-7fcf-446b-8bd3-9dad2d4444a9 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:45.386859 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3ef8cc1f-7fcf-446b-8bd3-9dad2d4444a9 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:45.387367 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3ef8cc1f-7fcf-446b-8bd3-9dad2d4444a9 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:45.506422 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-f064a098-ae24-49de-a09c-dee0525a91d0 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] 10.222.0.32 "POST /compute/v2.1/servers/f99a1e0b-a450-43f6-82ca-32c64eac21b4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.283900 May 30 12:07:45.507284 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 253/493] 10.222.0.32 () {60 vars in 1322 bytes} [Mon May 30 12:07:45 2022] POST /compute/v2.1/servers/f99a1e0b-a450-43f6-82ca-32c64eac21b4/os-volume_attachments => generated 194 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:07:45.527746 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-3ef8cc1f-7fcf-446b-8bd3-9dad2d4444a9 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76e8d7bfdc04ea79c83ca7fb6b9ade1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5074cf3e6248668995f266845c8969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:45.535623 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-3ef8cc1f-7fcf-446b-8bd3-9dad2d4444a9 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed" status: 200 len: 1677 microversion: 2.1 time: 0.168406 May 30 12:07:45.536820 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 241/494] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:07:45 2022] GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed => generated 1677 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:07:46.553594 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-31102177-fbdb-4c1f-a0a8-6587f9f6da1a tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:46.554344 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-31102177-fbdb-4c1f-a0a8-6587f9f6da1a tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 08b1b860-516e-4041-8df8-1fa8cc65a4ed] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:46.561297 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-31102177-fbdb-4c1f-a0a8-6587f9f6da1a tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:46.561744 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-31102177-fbdb-4c1f-a0a8-6587f9f6da1a tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:46.562511 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-31102177-fbdb-4c1f-a0a8-6587f9f6da1a tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:46.562943 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-31102177-fbdb-4c1f-a0a8-6587f9f6da1a tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:46.692624 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-31102177-fbdb-4c1f-a0a8-6587f9f6da1a tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76e8d7bfdc04ea79c83ca7fb6b9ade1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5074cf3e6248668995f266845c8969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:46.700296 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-31102177-fbdb-4c1f-a0a8-6587f9f6da1a tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed" status: 200 len: 1677 microversion: 2.1 time: 0.150900 May 30 12:07:46.700858 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 254/495] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:07:46 2022] GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:47.718822 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-0ed69ca8-ba48-471f-8806-169ba26eff51 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:47.719460 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-0ed69ca8-ba48-471f-8806-169ba26eff51 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 08b1b860-516e-4041-8df8-1fa8cc65a4ed] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:47.726597 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-0ed69ca8-ba48-471f-8806-169ba26eff51 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:47.726978 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-0ed69ca8-ba48-471f-8806-169ba26eff51 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:47.727746 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-0ed69ca8-ba48-471f-8806-169ba26eff51 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:47.728197 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-0ed69ca8-ba48-471f-8806-169ba26eff51 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:47.866314 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-0ed69ca8-ba48-471f-8806-169ba26eff51 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76e8d7bfdc04ea79c83ca7fb6b9ade1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5074cf3e6248668995f266845c8969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:47.874420 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-0ed69ca8-ba48-471f-8806-169ba26eff51 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed" status: 200 len: 1677 microversion: 2.1 time: 0.159384 May 30 12:07:47.874944 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 242/496] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:07:47 2022] GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:48.266772 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-862ca08b-72ea-4018-8f57-3eead9768841 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:48.267301 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-862ca08b-72ea-4018-8f57-3eead9768841 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: 611aebbd-06cc-46a9-ba2f-a01decf8d94a] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:48.274545 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-862ca08b-72ea-4018-8f57-3eead9768841 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:48.274996 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-862ca08b-72ea-4018-8f57-3eead9768841 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:48.275760 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-862ca08b-72ea-4018-8f57-3eead9768841 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:48.276221 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-862ca08b-72ea-4018-8f57-3eead9768841 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:48.300455 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-862ca08b-72ea-4018-8f57-3eead9768841 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/611aebbd-06cc-46a9-ba2f-a01decf8d94a/ips" status: 200 len: 149 microversion: 2.1 time: 0.037580 May 30 12:07:48.301064 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 255/497] 10.222.0.32 () {58 vars in 1247 bytes} [Mon May 30 12:07:48 2022] GET /compute/v2.1/servers/611aebbd-06cc-46a9-ba2f-a01decf8d94a/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 30 12:07:48.311836 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-dd382510-3791-4f9f-81f1-836ab042778f tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "55d71715-3141-49dc-bb9c-8223542716fa"}} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:07:48.313019 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-dd382510-3791-4f9f-81f1-836ab042778f tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: 611aebbd-06cc-46a9-ba2f-a01decf8d94a] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:48.319212 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-dd382510-3791-4f9f-81f1-836ab042778f tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:48.319654 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-dd382510-3791-4f9f-81f1-836ab042778f tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:48.320666 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-dd382510-3791-4f9f-81f1-836ab042778f tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:48.321142 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-dd382510-3791-4f9f-81f1-836ab042778f tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:48.409657 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.wsgi [None req-dd382510-3791-4f9f-81f1-836ab042778f tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] HTTP exception thrown: Invalid volume: volume 55d71715-3141-49dc-bb9c-8223542716fa is already attached to instances: 54ad4de0-2282-4baf-86a4-40d5ba1ba62a May 30 12:07:48.411371 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-dd382510-3791-4f9f-81f1-836ab042778f tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Request method failure captured: May 30 12:07:48.411371 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: request: POST /compute/v2.1/servers/611aebbd-06cc-46a9-ba2f-a01decf8d94a/os-volume_attachments HTTP/1.1 May 30 12:07:48.411371 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Accept: application/json May 30 12:07:48.411371 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Accept-Encoding: identity May 30 12:07:48.411371 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Connection: close May 30 12:07:48.411371 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Content-Length: 74 May 30 12:07:48.411371 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Content-Type: application/json May 30 12:07:48.411371 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Host: 10.222.0.32 May 30 12:07:48.411371 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Openstack-System-Scope: None May 30 12:07:48.411371 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: User-Agent: python-urllib3/1.26.9 May 30 12:07:48.411371 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Auth-Token: gAAAAABilLLAYcX6lTFc6UYhtte3qOfoT2D6p3xmrlj8lFSs8RM3SsxCJSweWMgYMCOyRE51N8YW3rSrU1JYG-ztTk5m_gEJkCNSzYatjS4LK9S2ataZ1OqgPb6zqIfN7SdtrBc2fQRHJMFEqwi_DhRkSGnSViHvbRwm6OQNgq1VdpWmApLUG3U May 30 12:07:48.411371 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Domain-Id: None May 30 12:07:48.411371 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Domain-Name: None May 30 12:07:48.411371 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Identity-Status: Confirmed May 30 12:07:48.411371 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Is-Admin-Project: True May 30 12:07:48.411371 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Domain-Id: default May 30 12:07:48.411371 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Domain-Name: Default May 30 12:07:48.411371 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Id: 20763921c37c4e81bba702e09bf628b2 May 30 12:07:48.411371 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Name: tempest-AttachVolumeNegativeTest-1368164951 May 30 12:07:48.411371 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Role: reader,member May 30 12:07:48.411371 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Roles: reader,member May 30 12:07:48.413057 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/20763921c37c4e81bba702e09bf628b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/20763921c37c4e81bba702e09bf628b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/20763921c37c4e81bba702e09bf628b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_20763921c37c4e81bba702e09bf628b2", "adminURL": "http://10.222.0.32:8080"}]}] May 30 12:07:48.413057 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant: tempest-AttachVolumeNegativeTest-1368164951 May 30 12:07:48.413057 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant-Id: 20763921c37c4e81bba702e09bf628b2 May 30 12:07:48.413057 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1368164951 May 30 12:07:48.413057 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User: tempest-AttachVolumeNegativeTest-1368164951-project May 30 12:07:48.413057 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Domain-Id: default May 30 12:07:48.413057 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Domain-Name: Default May 30 12:07:48.413057 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Id: 7575179edbda45208561c983fc5b956c May 30 12:07:48.413057 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Name: tempest-AttachVolumeNegativeTest-1368164951-project May 30 12:07:48.413057 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: May 30 12:07:48.413057 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: {"volumeAttachment": {"volumeId": "55d71715-3141-49dc-bb9c-8223542716fa"}} May 30 12:07:48.413057 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: method: > May 30 12:07:48.414458 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: exception: Invalid volume: volume 55d71715-3141-49dc-bb9c-8223542716fa is already attached to instances: 54ad4de0-2282-4baf-86a4-40d5ba1ba62a May 30 12:07:48.414458 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: action_args: {'server_id': '611aebbd-06cc-46a9-ba2f-a01decf8d94a', 'body': {'volumeAttachment': {'volumeId': '55d71715-3141-49dc-bb9c-8223542716fa'}}} May 30 12:07:48.414458 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:07:48.414458 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:07:48.414458 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 30 12:07:48.414458 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 30 12:07:48.414458 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 30 12:07:48.414458 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 30 12:07:48.414458 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 30 12:07:48.414458 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 30 12:07:48.414458 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 30 12:07:48.414458 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 30 12:07:48.414458 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 30 12:07:48.414458 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 30 12:07:48.414458 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 55d71715-3141-49dc-bb9c-8223542716fa is already attached to instances: 54ad4de0-2282-4baf-86a4-40d5ba1ba62a May 30 12:07:48.414458 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:07:48.414458 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:07:48.414458 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:07:48.414458 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:07:48.415641 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:07:48.415641 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:07:48.415641 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:07:48.415641 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:07:48.415641 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:07:48.415641 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:07:48.415641 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 30 12:07:48.415641 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 30 12:07:48.415641 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 30 12:07:48.415641 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 30 12:07:48.415641 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 30 12:07:48.415641 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 30 12:07:48.415641 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 30 12:07:48.415641 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 30 12:07:48.415641 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 55d71715-3141-49dc-bb9c-8223542716fa is already attached to instances: 54ad4de0-2282-4baf-86a4-40d5ba1ba62a May 30 12:07:48.415641 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:07:48.415641 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:07:48.415641 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:07:48.415641 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:07:48.415641 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:07:48.416956 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:07:48.416956 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:07:48.416956 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:07:48.416956 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 55d71715-3141-49dc-bb9c-8223542716fa is already attached to instances: 54ad4de0-2282-4baf-86a4-40d5ba1ba62a May 30 12:07:48.416956 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:07:48.416956 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-dd382510-3791-4f9f-81f1-836ab042778f tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Returning 400 to user: Invalid volume: volume 55d71715-3141-49dc-bb9c-8223542716fa is already attached to instances: 54ad4de0-2282-4baf-86a4-40d5ba1ba62a {{(pid=117670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:07:48.416956 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-dd382510-3791-4f9f-81f1-836ab042778f tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "POST /compute/v2.1/servers/611aebbd-06cc-46a9-ba2f-a01decf8d94a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.105043 May 30 12:07:48.416956 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 243/498] 10.222.0.32 () {60 vars in 1322 bytes} [Mon May 30 12:07:48 2022] POST /compute/v2.1/servers/611aebbd-06cc-46a9-ba2f-a01decf8d94a/os-volume_attachments => generated 174 bytes in 106 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 30 12:07:48.423040 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-32751e2a-837e-4cf5-8c43-7341799eb064 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:48.423551 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-32751e2a-837e-4cf5-8c43-7341799eb064 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: 611aebbd-06cc-46a9-ba2f-a01decf8d94a] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:48.430416 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-32751e2a-837e-4cf5-8c43-7341799eb064 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:48.430856 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-32751e2a-837e-4cf5-8c43-7341799eb064 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:48.431619 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-32751e2a-837e-4cf5-8c43-7341799eb064 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:48.432052 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-32751e2a-837e-4cf5-8c43-7341799eb064 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:48.455948 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-32751e2a-837e-4cf5-8c43-7341799eb064 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: 611aebbd-06cc-46a9-ba2f-a01decf8d94a] Going to try to terminate instance {{(pid=117671) delete /opt/stack/nova/nova/compute/api.py:2664}} May 30 12:07:48.533525 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-32751e2a-837e-4cf5-8c43-7341799eb064 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "DELETE /compute/v2.1/servers/611aebbd-06cc-46a9-ba2f-a01decf8d94a" status: 204 len: 0 microversion: 2.1 time: 0.113866 May 30 12:07:48.534125 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 256/499] 10.222.0.32 () {58 vars in 1238 bytes} [Mon May 30 12:07:48 2022] DELETE /compute/v2.1/servers/611aebbd-06cc-46a9-ba2f-a01decf8d94a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 30 12:07:48.543305 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-517452cb-e572-4a19-b45a-616e2144c800 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:48.544718 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-517452cb-e572-4a19-b45a-616e2144c800 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: 611aebbd-06cc-46a9-ba2f-a01decf8d94a] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:48.552412 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-517452cb-e572-4a19-b45a-616e2144c800 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:48.552868 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-517452cb-e572-4a19-b45a-616e2144c800 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:48.553680 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-517452cb-e572-4a19-b45a-616e2144c800 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:48.554089 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-517452cb-e572-4a19-b45a-616e2144c800 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:48.684727 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-517452cb-e572-4a19-b45a-616e2144c800 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7575179edbda45208561c983fc5b956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20763921c37c4e81bba702e09bf628b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:48.692659 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-517452cb-e572-4a19-b45a-616e2144c800 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/611aebbd-06cc-46a9-ba2f-a01decf8d94a" status: 200 len: 1679 microversion: 2.1 time: 0.154214 May 30 12:07:48.693222 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 244/500] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:07:48 2022] GET /compute/v2.1/servers/611aebbd-06cc-46a9-ba2f-a01decf8d94a => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:48.892947 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-ab74e552-de6a-41de-bde2-a4a9ce826098 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:48.893546 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-ab74e552-de6a-41de-bde2-a4a9ce826098 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 08b1b860-516e-4041-8df8-1fa8cc65a4ed] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:48.900928 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ab74e552-de6a-41de-bde2-a4a9ce826098 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:48.901415 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ab74e552-de6a-41de-bde2-a4a9ce826098 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:48.902187 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ab74e552-de6a-41de-bde2-a4a9ce826098 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:48.902623 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ab74e552-de6a-41de-bde2-a4a9ce826098 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:49.035005 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-ab74e552-de6a-41de-bde2-a4a9ce826098 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76e8d7bfdc04ea79c83ca7fb6b9ade1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5074cf3e6248668995f266845c8969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:49.037375 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:49.045124 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-ab74e552-de6a-41de-bde2-a4a9ce826098 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed" status: 200 len: 1677 microversion: 2.1 time: 0.156608 May 30 12:07:49.045694 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 257/501] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:07:48 2022] GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:49.710158 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-343a9a87-5361-47a9-a270-0c50ede6fc4e tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:49.711115 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-343a9a87-5361-47a9-a270-0c50ede6fc4e tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: 611aebbd-06cc-46a9-ba2f-a01decf8d94a] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:49.717641 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-343a9a87-5361-47a9-a270-0c50ede6fc4e tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:49.718082 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-343a9a87-5361-47a9-a270-0c50ede6fc4e tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:49.718836 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-343a9a87-5361-47a9-a270-0c50ede6fc4e tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:49.719265 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-343a9a87-5361-47a9-a270-0c50ede6fc4e tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:49.850682 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-343a9a87-5361-47a9-a270-0c50ede6fc4e tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7575179edbda45208561c983fc5b956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20763921c37c4e81bba702e09bf628b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:49.858255 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-343a9a87-5361-47a9-a270-0c50ede6fc4e tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/611aebbd-06cc-46a9-ba2f-a01decf8d94a" status: 200 len: 1679 microversion: 2.1 time: 0.151975 May 30 12:07:49.858828 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 245/502] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:07:49 2022] GET /compute/v2.1/servers/611aebbd-06cc-46a9-ba2f-a01decf8d94a => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:50.062473 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-fc6f6f49-a106-4a05-9e28-1b0624b3d0a1 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:50.063084 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-fc6f6f49-a106-4a05-9e28-1b0624b3d0a1 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 08b1b860-516e-4041-8df8-1fa8cc65a4ed] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:50.071308 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-fc6f6f49-a106-4a05-9e28-1b0624b3d0a1 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:50.071758 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-fc6f6f49-a106-4a05-9e28-1b0624b3d0a1 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:50.072889 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-fc6f6f49-a106-4a05-9e28-1b0624b3d0a1 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:50.073464 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-fc6f6f49-a106-4a05-9e28-1b0624b3d0a1 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:50.206471 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-fc6f6f49-a106-4a05-9e28-1b0624b3d0a1 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76e8d7bfdc04ea79c83ca7fb6b9ade1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5074cf3e6248668995f266845c8969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:50.215512 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-fc6f6f49-a106-4a05-9e28-1b0624b3d0a1 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed" status: 200 len: 1677 microversion: 2.1 time: 0.157186 May 30 12:07:50.216097 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 258/503] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:07:50 2022] GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:50.420083 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-13c52c25-3752-426e-aba5-a4ebffd6708d tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4ae317b9-5467-4b66-acdd-880a45951304"}} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:07:50.420083 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-13c52c25-3752-426e-aba5-a4ebffd6708d tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 83f672fe-d699-4f70-bc26-74dced714a5d] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:50.422512 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-13c52c25-3752-426e-aba5-a4ebffd6708d tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:50.422954 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-13c52c25-3752-426e-aba5-a4ebffd6708d tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:50.423763 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-13c52c25-3752-426e-aba5-a4ebffd6708d tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:50.424223 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-13c52c25-3752-426e-aba5-a4ebffd6708d tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:50.679997 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-13c52c25-3752-426e-aba5-a4ebffd6708d tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "POST /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.268670 May 30 12:07:50.680904 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 246/504] 10.222.0.32 () {60 vars in 1322 bytes} [Mon May 30 12:07:50 2022] POST /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d/os-volume_attachments => generated 194 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:07:50.875273 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-46436e24-b8eb-4439-a046-8b29abbbaa8f tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:50.875998 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-46436e24-b8eb-4439-a046-8b29abbbaa8f tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: 611aebbd-06cc-46a9-ba2f-a01decf8d94a] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:50.882836 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-46436e24-b8eb-4439-a046-8b29abbbaa8f tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:50.883381 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-46436e24-b8eb-4439-a046-8b29abbbaa8f tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:50.884300 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-46436e24-b8eb-4439-a046-8b29abbbaa8f tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:50.884742 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-46436e24-b8eb-4439-a046-8b29abbbaa8f tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:51.234396 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-8cdabb01-4fe7-4931-af21-facae55b25f5 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:51.235851 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-8cdabb01-4fe7-4931-af21-facae55b25f5 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 08b1b860-516e-4041-8df8-1fa8cc65a4ed] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:51.243887 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8cdabb01-4fe7-4931-af21-facae55b25f5 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:51.244751 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8cdabb01-4fe7-4931-af21-facae55b25f5 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:51.245810 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8cdabb01-4fe7-4931-af21-facae55b25f5 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:51.246579 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8cdabb01-4fe7-4931-af21-facae55b25f5 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:51.258734 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-46436e24-b8eb-4439-a046-8b29abbbaa8f tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7575179edbda45208561c983fc5b956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20763921c37c4e81bba702e09bf628b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:51.267510 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-46436e24-b8eb-4439-a046-8b29abbbaa8f tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/611aebbd-06cc-46a9-ba2f-a01decf8d94a" status: 200 len: 1679 microversion: 2.1 time: 0.395975 May 30 12:07:51.268520 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 259/505] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:07:50 2022] GET /compute/v2.1/servers/611aebbd-06cc-46a9-ba2f-a01decf8d94a => generated 1679 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:51.399506 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-8cdabb01-4fe7-4931-af21-facae55b25f5 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76e8d7bfdc04ea79c83ca7fb6b9ade1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5074cf3e6248668995f266845c8969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:51.407830 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-8cdabb01-4fe7-4931-af21-facae55b25f5 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed" status: 200 len: 1677 microversion: 2.1 time: 0.178417 May 30 12:07:51.418540 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 247/506] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:07:51 2022] GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed => generated 1677 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:07:51.526305 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-de44cd9f-7ce3-4dc3-8796-e3d7486c4801 req-b4dbb630-7ca6-4407-af32-f1398f655e3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "611aebbd-06cc-46a9-ba2f-a01decf8d94a", "name": "network-vif-deleted", "tag": "8206cdb6-1ac2-439c-8225-5f66c1635ad9"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:07:51.534732 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-de44cd9f-7ce3-4dc3-8796-e3d7486c4801 req-b4dbb630-7ca6-4407-af32-f1398f655e3a service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:51.535307 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-de44cd9f-7ce3-4dc3-8796-e3d7486c4801 req-b4dbb630-7ca6-4407-af32-f1398f655e3a service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:51.546702 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-de44cd9f-7ce3-4dc3-8796-e3d7486c4801 req-b4dbb630-7ca6-4407-af32-f1398f655e3a service nova] Creating event network-vif-deleted:8206cdb6-1ac2-439c-8225-5f66c1635ad9 for instance 611aebbd-06cc-46a9-ba2f-a01decf8d94a on hv-cinder-84051 May 30 12:07:51.551815 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-de44cd9f-7ce3-4dc3-8796-e3d7486c4801 req-b4dbb630-7ca6-4407-af32-f1398f655e3a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030166 May 30 12:07:51.552735 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 260/507] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:07:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:07:52.286878 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-6fd9afab-800c-4e25-b464-861fcf19f3f0 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:52.287522 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-6fd9afab-800c-4e25-b464-861fcf19f3f0 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: 611aebbd-06cc-46a9-ba2f-a01decf8d94a] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:52.296486 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6fd9afab-800c-4e25-b464-861fcf19f3f0 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:52.297853 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6fd9afab-800c-4e25-b464-861fcf19f3f0 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:52.298868 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6fd9afab-800c-4e25-b464-861fcf19f3f0 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:52.299795 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6fd9afab-800c-4e25-b464-861fcf19f3f0 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:52.350590 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6fd9afab-800c-4e25-b464-861fcf19f3f0 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:52.352078 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6fd9afab-800c-4e25-b464-861fcf19f3f0 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:52.352572 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.objects.instance [None req-6fd9afab-800c-4e25-b464-861fcf19f3f0 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lazy-loading 'fault' on Instance uuid 611aebbd-06cc-46a9-ba2f-a01decf8d94a {{(pid=117670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 30 12:07:52.403759 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-6fd9afab-800c-4e25-b464-861fcf19f3f0 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7575179edbda45208561c983fc5b956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20763921c37c4e81bba702e09bf628b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:52.412009 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-6fd9afab-800c-4e25-b464-861fcf19f3f0 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/611aebbd-06cc-46a9-ba2f-a01decf8d94a" status: 200 len: 1330 microversion: 2.1 time: 0.128877 May 30 12:07:52.412618 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 248/508] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:07:52 2022] GET /compute/v2.1/servers/611aebbd-06cc-46a9-ba2f-a01decf8d94a => generated 1330 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:52.426883 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-d0c3c17d-75ad-4fcf-a518-00ac9edec5b3 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:52.427569 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-d0c3c17d-75ad-4fcf-a518-00ac9edec5b3 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 08b1b860-516e-4041-8df8-1fa8cc65a4ed] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:52.435358 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d0c3c17d-75ad-4fcf-a518-00ac9edec5b3 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:52.435810 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d0c3c17d-75ad-4fcf-a518-00ac9edec5b3 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:52.436619 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d0c3c17d-75ad-4fcf-a518-00ac9edec5b3 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:52.437057 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d0c3c17d-75ad-4fcf-a518-00ac9edec5b3 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:52.673742 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-d0c3c17d-75ad-4fcf-a518-00ac9edec5b3 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76e8d7bfdc04ea79c83ca7fb6b9ade1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5074cf3e6248668995f266845c8969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:52.682635 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-d0c3c17d-75ad-4fcf-a518-00ac9edec5b3 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed" status: 200 len: 1654 microversion: 2.1 time: 0.260460 May 30 12:07:52.683228 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 261/509] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:07:52 2022] GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed => generated 1654 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:52.704751 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-19856fe2-edcf-47b1-945a-3771e8b17db9 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:07:52.716932 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-19856fe2-edcf-47b1-945a-3771e8b17db9 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:52.717679 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-19856fe2-edcf-47b1-945a-3771e8b17db9 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:52.752656 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-19856fe2-edcf-47b1-945a-3771e8b17db9 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 08b1b860-516e-4041-8df8-1fa8cc65a4ed] Going to try to start instance {{(pid=117670) start /opt/stack/nova/nova/compute/api.py:2730}} May 30 12:07:52.803286 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-19856fe2-edcf-47b1-945a-3771e8b17db9 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "POST /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed/action" status: 202 len: 0 microversion: 2.1 time: 0.107641 May 30 12:07:52.804442 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 249/510] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 30 12:07:52 2022] POST /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 30 12:07:52.819758 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-715c9b37-f332-4b27-82c0-446fce011b6f tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:52.822179 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-715c9b37-f332-4b27-82c0-446fce011b6f tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 08b1b860-516e-4041-8df8-1fa8cc65a4ed] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:52.837118 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-715c9b37-f332-4b27-82c0-446fce011b6f tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:52.837858 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-715c9b37-f332-4b27-82c0-446fce011b6f tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:52.838891 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-715c9b37-f332-4b27-82c0-446fce011b6f tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:52.839565 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-715c9b37-f332-4b27-82c0-446fce011b6f tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:53.035649 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-715c9b37-f332-4b27-82c0-446fce011b6f tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76e8d7bfdc04ea79c83ca7fb6b9ade1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5074cf3e6248668995f266845c8969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:53.045998 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-715c9b37-f332-4b27-82c0-446fce011b6f tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed" status: 200 len: 1663 microversion: 2.1 time: 0.236033 May 30 12:07:53.046605 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 262/511] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:07:52 2022] GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed => generated 1663 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:53.430418 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-78742d68-ce46-43c6-876d-dde518ebff7c tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:53.431166 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-78742d68-ce46-43c6-876d-dde518ebff7c tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: 611aebbd-06cc-46a9-ba2f-a01decf8d94a] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:53.438083 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-78742d68-ce46-43c6-876d-dde518ebff7c tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:53.438524 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-78742d68-ce46-43c6-876d-dde518ebff7c tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:53.439288 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-78742d68-ce46-43c6-876d-dde518ebff7c tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:53.439715 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-78742d68-ce46-43c6-876d-dde518ebff7c tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:53.454851 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.wsgi [None req-78742d68-ce46-43c6-876d-dde518ebff7c tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] HTTP exception thrown: Instance 611aebbd-06cc-46a9-ba2f-a01decf8d94a could not be found. May 30 12:07:53.456560 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-78742d68-ce46-43c6-876d-dde518ebff7c tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Request method failure captured: May 30 12:07:53.456560 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: request: GET /compute/v2.1/servers/611aebbd-06cc-46a9-ba2f-a01decf8d94a HTTP/1.1 May 30 12:07:53.456560 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Accept: application/json May 30 12:07:53.456560 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Accept-Encoding: identity May 30 12:07:53.456560 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Connection: close May 30 12:07:53.456560 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Content-Length: 0 May 30 12:07:53.456560 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Content-Type: application/json May 30 12:07:53.456560 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Host: 10.222.0.32 May 30 12:07:53.456560 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Openstack-System-Scope: None May 30 12:07:53.456560 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: User-Agent: python-urllib3/1.26.9 May 30 12:07:53.456560 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Auth-Token: gAAAAABilLLAYcX6lTFc6UYhtte3qOfoT2D6p3xmrlj8lFSs8RM3SsxCJSweWMgYMCOyRE51N8YW3rSrU1JYG-ztTk5m_gEJkCNSzYatjS4LK9S2ataZ1OqgPb6zqIfN7SdtrBc2fQRHJMFEqwi_DhRkSGnSViHvbRwm6OQNgq1VdpWmApLUG3U May 30 12:07:53.456560 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Domain-Id: None May 30 12:07:53.456560 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Domain-Name: None May 30 12:07:53.456560 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Identity-Status: Confirmed May 30 12:07:53.456560 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Is-Admin-Project: True May 30 12:07:53.456560 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Domain-Id: default May 30 12:07:53.456560 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Domain-Name: Default May 30 12:07:53.456560 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Id: 20763921c37c4e81bba702e09bf628b2 May 30 12:07:53.456560 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Name: tempest-AttachVolumeNegativeTest-1368164951 May 30 12:07:53.456560 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Role: reader,member May 30 12:07:53.456560 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Roles: reader,member May 30 12:07:53.458139 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/20763921c37c4e81bba702e09bf628b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/20763921c37c4e81bba702e09bf628b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/20763921c37c4e81bba702e09bf628b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_20763921c37c4e81bba702e09bf628b2", "adminURL": "http://10.222.0.32:8080"}]}] May 30 12:07:53.458139 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant: tempest-AttachVolumeNegativeTest-1368164951 May 30 12:07:53.458139 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant-Id: 20763921c37c4e81bba702e09bf628b2 May 30 12:07:53.458139 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1368164951 May 30 12:07:53.458139 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User: tempest-AttachVolumeNegativeTest-1368164951-project May 30 12:07:53.458139 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Domain-Id: default May 30 12:07:53.458139 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Domain-Name: Default May 30 12:07:53.458139 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Id: 7575179edbda45208561c983fc5b956c May 30 12:07:53.458139 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Name: tempest-AttachVolumeNegativeTest-1368164951-project May 30 12:07:53.458139 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: method: > May 30 12:07:53.458139 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: exception: Instance 611aebbd-06cc-46a9-ba2f-a01decf8d94a could not be found. May 30 12:07:53.458139 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: action_args: {'id': '611aebbd-06cc-46a9-ba2f-a01decf8d94a'} May 30 12:07:53.463100 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:07:53.463100 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:07:53.463100 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:07:53.463100 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:07:53.463100 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:07:53.463100 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:07:53.463100 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:07:53.463100 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:07:53.463100 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:07:53.463100 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:07:53.463100 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 611aebbd-06cc-46a9-ba2f-a01decf8d94a could not be found. May 30 12:07:53.463100 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:07:53.463100 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:07:53.463100 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:07:53.463100 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:07:53.463100 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:07:53.463100 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:07:53.463100 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:07:53.463100 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:07:53.463100 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:07:53.464560 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:07:53.464560 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 30 12:07:53.464560 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 30 12:07:53.464560 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 30 12:07:53.464560 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 30 12:07:53.464560 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:07:53.464560 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:07:53.464560 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 611aebbd-06cc-46a9-ba2f-a01decf8d94a could not be found. May 30 12:07:53.464560 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:07:53.464560 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:07:53.464560 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:07:53.464560 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:07:53.464560 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:07:53.464560 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:07:53.464560 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:07:53.464560 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:07:53.464560 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 611aebbd-06cc-46a9-ba2f-a01decf8d94a could not be found. May 30 12:07:53.464560 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:07:53.465873 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-78742d68-ce46-43c6-876d-dde518ebff7c tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Returning 404 to user: Instance 611aebbd-06cc-46a9-ba2f-a01decf8d94a could not be found. {{(pid=117670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:07:53.465873 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-78742d68-ce46-43c6-876d-dde518ebff7c tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/611aebbd-06cc-46a9-ba2f-a01decf8d94a" status: 404 len: 111 microversion: 2.1 time: 0.032350 May 30 12:07:53.465873 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 250/512] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:07:53 2022] GET /compute/v2.1/servers/611aebbd-06cc-46a9-ba2f-a01decf8d94a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 30 12:07:53.481644 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-b9dbb678-87bb-46ce-935b-2dc32706af57 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '.version_select at 0x7f0ef8866ca0>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:53.508191 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-b9dbb678-87bb-46ce-935b-2dc32706af57 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-937841626" status: 202 len: 0 microversion: 2.1 time: 0.039923 May 30 12:07:53.508786 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 263/513] 10.222.0.32 () {58 vars in 1217 bytes} [Mon May 30 12:07:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-937841626 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 30 12:07:54.063111 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-b0a85f8f-8d5e-41b1-97b3-13ec3764b886 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:54.063905 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-b0a85f8f-8d5e-41b1-97b3-13ec3764b886 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 08b1b860-516e-4041-8df8-1fa8cc65a4ed] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:54.070937 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b0a85f8f-8d5e-41b1-97b3-13ec3764b886 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:54.071391 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b0a85f8f-8d5e-41b1-97b3-13ec3764b886 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:54.072190 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b0a85f8f-8d5e-41b1-97b3-13ec3764b886 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:54.074432 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b0a85f8f-8d5e-41b1-97b3-13ec3764b886 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:54.196830 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-e4a145e4-aecd-45b1-9f04-fd07131e6654 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:54.197581 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-e4a145e4-aecd-45b1-9f04-fd07131e6654 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: 54ad4de0-2282-4baf-86a4-40d5ba1ba62a] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:54.203582 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e4a145e4-aecd-45b1-9f04-fd07131e6654 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:54.204109 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e4a145e4-aecd-45b1-9f04-fd07131e6654 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:54.204973 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e4a145e4-aecd-45b1-9f04-fd07131e6654 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:54.205491 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e4a145e4-aecd-45b1-9f04-fd07131e6654 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:54.216435 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-b0a85f8f-8d5e-41b1-97b3-13ec3764b886 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76e8d7bfdc04ea79c83ca7fb6b9ade1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5074cf3e6248668995f266845c8969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:54.224413 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-b0a85f8f-8d5e-41b1-97b3-13ec3764b886 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed" status: 200 len: 1663 microversion: 2.1 time: 0.165263 May 30 12:07:54.224977 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 251/514] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:07:54 2022] GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed => generated 1663 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:07:54.289131 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.objects.instance [None req-e4a145e4-aecd-45b1-9f04-fd07131e6654 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lazy-loading 'services' on Instance uuid 54ad4de0-2282-4baf-86a4-40d5ba1ba62a {{(pid=117671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 30 12:07:54.360694 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-e4a145e4-aecd-45b1-9f04-fd07131e6654 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "DELETE /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a/os-volume_attachments/55d71715-3141-49dc-bb9c-8223542716fa" status: 202 len: 0 microversion: 2.1 time: 0.168199 May 30 12:07:54.361286 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 264/515] 10.222.0.32 () {58 vars in 1415 bytes} [Mon May 30 12:07:54 2022] DELETE /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a/os-volume_attachments/55d71715-3141-49dc-bb9c-8223542716fa => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 30 12:07:54.370229 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-d73b5bb0-0b30-4861-b7f2-d1e32ae595da tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:54.371248 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-d73b5bb0-0b30-4861-b7f2-d1e32ae595da tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: 54ad4de0-2282-4baf-86a4-40d5ba1ba62a] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:54.373272 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_api:SELECT=62 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:54.378795 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d73b5bb0-0b30-4861-b7f2-d1e32ae595da tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:54.379244 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d73b5bb0-0b30-4861-b7f2-d1e32ae595da tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:54.380077 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d73b5bb0-0b30-4861-b7f2-d1e32ae595da tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:54.380561 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d73b5bb0-0b30-4861-b7f2-d1e32ae595da tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:54.411311 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-d73b5bb0-0b30-4861-b7f2-d1e32ae595da tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045541 May 30 12:07:54.411869 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 252/516] 10.222.0.32 () {58 vars in 1301 bytes} [Mon May 30 12:07:54 2022] GET /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:07:55.242898 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-9ce894de-a97c-4b5e-a904-1bcc8c003545 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:55.243521 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-9ce894de-a97c-4b5e-a904-1bcc8c003545 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 08b1b860-516e-4041-8df8-1fa8cc65a4ed] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:55.249933 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9ce894de-a97c-4b5e-a904-1bcc8c003545 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:55.250380 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9ce894de-a97c-4b5e-a904-1bcc8c003545 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:55.251150 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9ce894de-a97c-4b5e-a904-1bcc8c003545 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:55.251587 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9ce894de-a97c-4b5e-a904-1bcc8c003545 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:55.393271 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-9ce894de-a97c-4b5e-a904-1bcc8c003545 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76e8d7bfdc04ea79c83ca7fb6b9ade1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5074cf3e6248668995f266845c8969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:55.402181 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-9ce894de-a97c-4b5e-a904-1bcc8c003545 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed" status: 200 len: 1663 microversion: 2.1 time: 0.164246 May 30 12:07:55.402749 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 265/517] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:07:55 2022] GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed => generated 1663 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:55.422880 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-54554748-b1eb-42ff-9b67-4d9463de2372 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:55.423806 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-54554748-b1eb-42ff-9b67-4d9463de2372 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: 54ad4de0-2282-4baf-86a4-40d5ba1ba62a] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:55.430425 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-54554748-b1eb-42ff-9b67-4d9463de2372 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:55.430873 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-54554748-b1eb-42ff-9b67-4d9463de2372 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:55.431640 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-54554748-b1eb-42ff-9b67-4d9463de2372 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:55.432075 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-54554748-b1eb-42ff-9b67-4d9463de2372 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:55.461784 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-54554748-b1eb-42ff-9b67-4d9463de2372 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042608 May 30 12:07:55.462329 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 253/518] 10.222.0.32 () {58 vars in 1301 bytes} [Mon May 30 12:07:55 2022] GET /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:07:56.419627 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-22b4dc05-509d-4b9a-a425-cf5875b3ef02 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:56.420289 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-22b4dc05-509d-4b9a-a425-cf5875b3ef02 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 08b1b860-516e-4041-8df8-1fa8cc65a4ed] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:56.426723 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-22b4dc05-509d-4b9a-a425-cf5875b3ef02 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:56.427181 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-22b4dc05-509d-4b9a-a425-cf5875b3ef02 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:56.427940 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-22b4dc05-509d-4b9a-a425-cf5875b3ef02 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:56.428399 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-22b4dc05-509d-4b9a-a425-cf5875b3ef02 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:56.474559 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-6d42d2a9-330b-43c5-9cf2-6be1bca0da34 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:56.475673 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-6d42d2a9-330b-43c5-9cf2-6be1bca0da34 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: 54ad4de0-2282-4baf-86a4-40d5ba1ba62a] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:56.483206 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6d42d2a9-330b-43c5-9cf2-6be1bca0da34 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:56.483693 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6d42d2a9-330b-43c5-9cf2-6be1bca0da34 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:56.485083 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6d42d2a9-330b-43c5-9cf2-6be1bca0da34 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:56.485801 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6d42d2a9-330b-43c5-9cf2-6be1bca0da34 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:56.523313 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-6d42d2a9-330b-43c5-9cf2-6be1bca0da34 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053364 May 30 12:07:56.524095 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 254/519] 10.222.0.32 () {58 vars in 1301 bytes} [Mon May 30 12:07:56 2022] GET /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 30 12:07:56.567955 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-22b4dc05-509d-4b9a-a425-cf5875b3ef02 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76e8d7bfdc04ea79c83ca7fb6b9ade1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5074cf3e6248668995f266845c8969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:56.575842 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-22b4dc05-509d-4b9a-a425-cf5875b3ef02 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed" status: 200 len: 1663 microversion: 2.1 time: 0.160002 May 30 12:07:56.576455 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 266/520] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:07:56 2022] GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed => generated 1663 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:57.535772 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-4e2837e8-c71c-443e-a2d1-fb5104958dd7 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:57.538787 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-4e2837e8-c71c-443e-a2d1-fb5104958dd7 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: 54ad4de0-2282-4baf-86a4-40d5ba1ba62a] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:57.546897 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4e2837e8-c71c-443e-a2d1-fb5104958dd7 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:57.547351 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4e2837e8-c71c-443e-a2d1-fb5104958dd7 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:57.548128 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4e2837e8-c71c-443e-a2d1-fb5104958dd7 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:57.548596 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4e2837e8-c71c-443e-a2d1-fb5104958dd7 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:57.566055 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:57.580763 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-4e2837e8-c71c-443e-a2d1-fb5104958dd7 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049594 May 30 12:07:57.581232 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 255/521] 10.222.0.32 () {58 vars in 1301 bytes} [Mon May 30 12:07:57 2022] GET /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:07:57.593796 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-80109b12-4d4b-48dc-b3b6-f6548fe297ef tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:57.594173 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-80109b12-4d4b-48dc-b3b6-f6548fe297ef tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 08b1b860-516e-4041-8df8-1fa8cc65a4ed] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:57.600610 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-80109b12-4d4b-48dc-b3b6-f6548fe297ef tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:57.601603 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-80109b12-4d4b-48dc-b3b6-f6548fe297ef tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:57.602370 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-80109b12-4d4b-48dc-b3b6-f6548fe297ef tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:57.602801 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-80109b12-4d4b-48dc-b3b6-f6548fe297ef tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:57.734669 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-80109b12-4d4b-48dc-b3b6-f6548fe297ef tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76e8d7bfdc04ea79c83ca7fb6b9ade1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5074cf3e6248668995f266845c8969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:57.742954 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-80109b12-4d4b-48dc-b3b6-f6548fe297ef tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed" status: 200 len: 1667 microversion: 2.1 time: 0.153590 May 30 12:07:57.743519 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 267/522] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:07:57 2022] GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed => generated 1667 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:58.593424 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-39a026b0-5fad-44ea-b647-a5fb6c68dd88 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:58.594383 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-39a026b0-5fad-44ea-b647-a5fb6c68dd88 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: 54ad4de0-2282-4baf-86a4-40d5ba1ba62a] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:58.601367 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-39a026b0-5fad-44ea-b647-a5fb6c68dd88 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:58.601854 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-39a026b0-5fad-44ea-b647-a5fb6c68dd88 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:58.602622 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-39a026b0-5fad-44ea-b647-a5fb6c68dd88 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:58.603221 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-39a026b0-5fad-44ea-b647-a5fb6c68dd88 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:58.633018 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-39a026b0-5fad-44ea-b647-a5fb6c68dd88 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043877 May 30 12:07:58.633601 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 256/523] 10.222.0.32 () {58 vars in 1301 bytes} [Mon May 30 12:07:58 2022] GET /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:07:59.644680 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-d6eeab2f-2851-4d9d-b23d-c6291992f8fa tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:59.645603 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-d6eeab2f-2851-4d9d-b23d-c6291992f8fa tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: 54ad4de0-2282-4baf-86a4-40d5ba1ba62a] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:59.653180 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d6eeab2f-2851-4d9d-b23d-c6291992f8fa tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:59.653617 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d6eeab2f-2851-4d9d-b23d-c6291992f8fa tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:59.654376 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d6eeab2f-2851-4d9d-b23d-c6291992f8fa tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:59.654798 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d6eeab2f-2851-4d9d-b23d-c6291992f8fa tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:59.683339 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-d6eeab2f-2851-4d9d-b23d-c6291992f8fa tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042871 May 30 12:07:59.683881 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 268/524] 10.222.0.32 () {58 vars in 1301 bytes} [Mon May 30 12:07:59 2022] GET /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:08:00.695229 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-6bb5d778-3115-4346-83fe-9c56fbad4659 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:00.696182 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-6bb5d778-3115-4346-83fe-9c56fbad4659 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: 54ad4de0-2282-4baf-86a4-40d5ba1ba62a] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:00.702668 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6bb5d778-3115-4346-83fe-9c56fbad4659 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:00.703116 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6bb5d778-3115-4346-83fe-9c56fbad4659 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:00.703872 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6bb5d778-3115-4346-83fe-9c56fbad4659 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:00.704333 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6bb5d778-3115-4346-83fe-9c56fbad4659 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:00.734136 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-6bb5d778-3115-4346-83fe-9c56fbad4659 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043231 May 30 12:08:00.734689 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 257/525] 10.222.0.32 () {58 vars in 1301 bytes} [Mon May 30 12:08:00 2022] GET /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:08:01.746751 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-90708761-068c-4c0d-8948-41212dd33e58 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:01.747680 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-90708761-068c-4c0d-8948-41212dd33e58 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: 54ad4de0-2282-4baf-86a4-40d5ba1ba62a] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:01.759332 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-90708761-068c-4c0d-8948-41212dd33e58 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:01.759818 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-90708761-068c-4c0d-8948-41212dd33e58 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:01.760667 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-90708761-068c-4c0d-8948-41212dd33e58 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:01.761098 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-90708761-068c-4c0d-8948-41212dd33e58 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:01.791785 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-90708761-068c-4c0d-8948-41212dd33e58 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049117 May 30 12:08:01.792614 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 269/526] 10.222.0.32 () {58 vars in 1301 bytes} [Mon May 30 12:08:01 2022] GET /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:08:02.475100 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-df1b2f95-b1ec-4cb6-9b95-bca0f5e0a549 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:08:02.477098 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-df1b2f95-b1ec-4cb6-9b95-bca0f5e0a549 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 83f672fe-d699-4f70-bc26-74dced714a5d] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:02.483526 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-df1b2f95-b1ec-4cb6-9b95-bca0f5e0a549 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:02.483969 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-df1b2f95-b1ec-4cb6-9b95-bca0f5e0a549 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:02.484769 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-df1b2f95-b1ec-4cb6-9b95-bca0f5e0a549 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:02.485191 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-df1b2f95-b1ec-4cb6-9b95-bca0f5e0a549 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:02.507660 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.objects.instance [None req-df1b2f95-b1ec-4cb6-9b95-bca0f5e0a549 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lazy-loading 'flavor' on Instance uuid 83f672fe-d699-4f70-bc26-74dced714a5d {{(pid=117670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 30 12:08:02.635149 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-df1b2f95-b1ec-4cb6-9b95-bca0f5e0a549 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "POST /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d/action" status: 200 len: 32 microversion: 2.1 time: 0.163927 May 30 12:08:02.635781 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 258/527] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 30 12:08:02 2022] POST /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d/action => generated 32 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 30 12:08:02.645225 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-76fa0df9-daa9-4b03-8f5b-5c9e0c39ef2d tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:02.645881 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-76fa0df9-daa9-4b03-8f5b-5c9e0c39ef2d tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 83f672fe-d699-4f70-bc26-74dced714a5d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:02.654925 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-76fa0df9-daa9-4b03-8f5b-5c9e0c39ef2d tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:02.655417 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-76fa0df9-daa9-4b03-8f5b-5c9e0c39ef2d tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:02.656405 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-76fa0df9-daa9-4b03-8f5b-5c9e0c39ef2d tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:02.656854 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-76fa0df9-daa9-4b03-8f5b-5c9e0c39ef2d tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:02.807764 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-faea9db3-9eee-4fc3-96a9-6e3aefc370a5 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:02.809047 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-faea9db3-9eee-4fc3-96a9-6e3aefc370a5 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: 54ad4de0-2282-4baf-86a4-40d5ba1ba62a] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:02.817414 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-faea9db3-9eee-4fc3-96a9-6e3aefc370a5 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:02.818112 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-faea9db3-9eee-4fc3-96a9-6e3aefc370a5 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:02.819721 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-faea9db3-9eee-4fc3-96a9-6e3aefc370a5 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:02.819919 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-76fa0df9-daa9-4b03-8f5b-5c9e0c39ef2d tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:02.821353 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-faea9db3-9eee-4fc3-96a9-6e3aefc370a5 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:02.833931 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-76fa0df9-daa9-4b03-8f5b-5c9e0c39ef2d tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d" status: 200 len: 1737 microversion: 2.1 time: 0.192595 May 30 12:08:02.835967 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 270/528] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:08:02 2022] GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d => generated 1737 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:02.858360 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-faea9db3-9eee-4fc3-96a9-6e3aefc370a5 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058399 May 30 12:08:02.858931 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 259/529] 10.222.0.32 () {58 vars in 1301 bytes} [Mon May 30 12:08:02 2022] GET /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 30 12:08:02.920812 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-3b800519-4309-4b00-bae3-84fdf52663ac tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:02.921311 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-3b800519-4309-4b00-bae3-84fdf52663ac tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: 54ad4de0-2282-4baf-86a4-40d5ba1ba62a] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:02.927654 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3b800519-4309-4b00-bae3-84fdf52663ac tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:02.928360 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3b800519-4309-4b00-bae3-84fdf52663ac tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:02.929553 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3b800519-4309-4b00-bae3-84fdf52663ac tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:02.929990 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3b800519-4309-4b00-bae3-84fdf52663ac tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:02.957337 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-3b800519-4309-4b00-bae3-84fdf52663ac tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: 54ad4de0-2282-4baf-86a4-40d5ba1ba62a] Going to try to terminate instance {{(pid=117671) delete /opt/stack/nova/nova/compute/api.py:2664}} May 30 12:08:03.043179 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-3b800519-4309-4b00-bae3-84fdf52663ac tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "DELETE /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a" status: 204 len: 0 microversion: 2.1 time: 0.125897 May 30 12:08:03.043784 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 271/530] 10.222.0.32 () {58 vars in 1238 bytes} [Mon May 30 12:08:02 2022] DELETE /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 30 12:08:03.052181 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-1bf2414a-fa6a-4b3b-b5e9-1b882cef0ffa tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:03.052808 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-1bf2414a-fa6a-4b3b-b5e9-1b882cef0ffa tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: 54ad4de0-2282-4baf-86a4-40d5ba1ba62a] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:03.059642 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1bf2414a-fa6a-4b3b-b5e9-1b882cef0ffa tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:03.060097 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1bf2414a-fa6a-4b3b-b5e9-1b882cef0ffa tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:03.060930 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1bf2414a-fa6a-4b3b-b5e9-1b882cef0ffa tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:03.061373 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1bf2414a-fa6a-4b3b-b5e9-1b882cef0ffa tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:03.198194 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-1bf2414a-fa6a-4b3b-b5e9-1b882cef0ffa tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7575179edbda45208561c983fc5b956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20763921c37c4e81bba702e09bf628b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:03.207262 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-1bf2414a-fa6a-4b3b-b5e9-1b882cef0ffa tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a" status: 200 len: 1682 microversion: 2.1 time: 0.158846 May 30 12:08:03.207836 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 260/531] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:08:03 2022] GET /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:03.853645 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-e542fb75-548b-4569-90ed-b6debffadd40 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:03.854344 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-e542fb75-548b-4569-90ed-b6debffadd40 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 83f672fe-d699-4f70-bc26-74dced714a5d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:03.861046 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e542fb75-548b-4569-90ed-b6debffadd40 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:03.861491 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e542fb75-548b-4569-90ed-b6debffadd40 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:03.862252 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e542fb75-548b-4569-90ed-b6debffadd40 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:03.862710 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e542fb75-548b-4569-90ed-b6debffadd40 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:04.004381 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-e542fb75-548b-4569-90ed-b6debffadd40 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:04.012614 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-e542fb75-548b-4569-90ed-b6debffadd40 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d" status: 200 len: 1737 microversion: 2.1 time: 0.164068 May 30 12:08:04.013196 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 272/532] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:08:03 2022] GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d => generated 1737 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:04.225795 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-288e3524-7994-45a8-8678-82f685ed2c8f tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:04.226392 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-288e3524-7994-45a8-8678-82f685ed2c8f tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: 54ad4de0-2282-4baf-86a4-40d5ba1ba62a] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:04.233006 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-288e3524-7994-45a8-8678-82f685ed2c8f tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:04.233462 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-288e3524-7994-45a8-8678-82f685ed2c8f tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:04.234238 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-288e3524-7994-45a8-8678-82f685ed2c8f tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:04.234680 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-288e3524-7994-45a8-8678-82f685ed2c8f tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:04.364799 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-288e3524-7994-45a8-8678-82f685ed2c8f tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7575179edbda45208561c983fc5b956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20763921c37c4e81bba702e09bf628b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:04.372391 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-288e3524-7994-45a8-8678-82f685ed2c8f tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a" status: 200 len: 1682 microversion: 2.1 time: 0.150675 May 30 12:08:04.372957 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 261/533] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:08:04 2022] GET /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:04.961699 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-833e932d-1fa7-41e9-aabc-882d4f7b71f7 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:04.962184 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-833e932d-1fa7-41e9-aabc-882d4f7b71f7 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] [instance: f99a1e0b-a450-43f6-82ca-32c64eac21b4] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:04.968628 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-833e932d-1fa7-41e9-aabc-882d4f7b71f7 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:04.969072 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-833e932d-1fa7-41e9-aabc-882d4f7b71f7 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:04.969826 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-833e932d-1fa7-41e9-aabc-882d4f7b71f7 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:04.970254 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-833e932d-1fa7-41e9-aabc-882d4f7b71f7 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:05.030543 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-3800b688-e572-433c-be4e-44c026db81dd tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:05.031157 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-3800b688-e572-433c-be4e-44c026db81dd tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 83f672fe-d699-4f70-bc26-74dced714a5d] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:05.037033 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3800b688-e572-433c-be4e-44c026db81dd tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:05.037467 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3800b688-e572-433c-be4e-44c026db81dd tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:05.038381 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3800b688-e572-433c-be4e-44c026db81dd tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:05.039116 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3800b688-e572-433c-be4e-44c026db81dd tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:05.059926 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:08:05.062438 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.objects.instance [None req-833e932d-1fa7-41e9-aabc-882d4f7b71f7 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lazy-loading 'services' on Instance uuid f99a1e0b-a450-43f6-82ca-32c64eac21b4 {{(pid=117671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 30 12:08:05.174321 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-833e932d-1fa7-41e9-aabc-882d4f7b71f7 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] 10.222.0.32 "DELETE /compute/v2.1/servers/f99a1e0b-a450-43f6-82ca-32c64eac21b4/os-volume_attachments/134e879e-6551-4583-bc8c-88ac901b5526" status: 202 len: 0 microversion: 2.1 time: 0.217339 May 30 12:08:05.174996 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 273/534] 10.222.0.32 () {58 vars in 1415 bytes} [Mon May 30 12:08:04 2022] DELETE /compute/v2.1/servers/f99a1e0b-a450-43f6-82ca-32c64eac21b4/os-volume_attachments/134e879e-6551-4583-bc8c-88ac901b5526 => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 30 12:08:05.220369 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-3800b688-e572-433c-be4e-44c026db81dd tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:05.233087 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-3800b688-e572-433c-be4e-44c026db81dd tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d" status: 200 len: 1737 microversion: 2.1 time: 0.205850 May 30 12:08:05.234253 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 262/535] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:08:05 2022] GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d => generated 1737 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:08:05.390982 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-6ec9da5d-de4f-492a-b0f0-e9f6ab3dbba4 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:05.391687 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-6ec9da5d-de4f-492a-b0f0-e9f6ab3dbba4 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: 54ad4de0-2282-4baf-86a4-40d5ba1ba62a] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:05.398654 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-6ec9da5d-de4f-492a-b0f0-e9f6ab3dbba4 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:05.399106 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-6ec9da5d-de4f-492a-b0f0-e9f6ab3dbba4 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:05.399886 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-6ec9da5d-de4f-492a-b0f0-e9f6ab3dbba4 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:05.400353 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-6ec9da5d-de4f-492a-b0f0-e9f6ab3dbba4 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:05.535365 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-6ec9da5d-de4f-492a-b0f0-e9f6ab3dbba4 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7575179edbda45208561c983fc5b956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20763921c37c4e81bba702e09bf628b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:05.543514 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-6ec9da5d-de4f-492a-b0f0-e9f6ab3dbba4 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a" status: 200 len: 1682 microversion: 2.1 time: 0.156997 May 30 12:08:05.544088 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 274/536] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:08:05 2022] GET /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:06.209303 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-b4889b35-d676-4869-9bba-a8b000c82e53 req-fbbd82b4-58a9-4167-b81f-283827bf337c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54ad4de0-2282-4baf-86a4-40d5ba1ba62a", "name": "network-vif-deleted", "tag": "f3718156-6792-4881-a093-e2245a9c75e4"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:08:06.220809 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-b4889b35-d676-4869-9bba-a8b000c82e53 req-fbbd82b4-58a9-4167-b81f-283827bf337c service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:06.221330 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-b4889b35-d676-4869-9bba-a8b000c82e53 req-fbbd82b4-58a9-4167-b81f-283827bf337c service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:06.242051 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-b4889b35-d676-4869-9bba-a8b000c82e53 req-fbbd82b4-58a9-4167-b81f-283827bf337c service nova] Creating event network-vif-deleted:f3718156-6792-4881-a093-e2245a9c75e4 for instance 54ad4de0-2282-4baf-86a4-40d5ba1ba62a on hv-cinder-84051 May 30 12:08:06.250877 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-4ed664e7-0916-4f5c-9c72-5dee121d40e0 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:06.251488 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-4ed664e7-0916-4f5c-9c72-5dee121d40e0 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 83f672fe-d699-4f70-bc26-74dced714a5d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:06.258513 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4ed664e7-0916-4f5c-9c72-5dee121d40e0 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:06.263567 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4ed664e7-0916-4f5c-9c72-5dee121d40e0 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:06.267778 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4ed664e7-0916-4f5c-9c72-5dee121d40e0 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:06.268291 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4ed664e7-0916-4f5c-9c72-5dee121d40e0 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:06.274462 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-b4889b35-d676-4869-9bba-a8b000c82e53 req-fbbd82b4-58a9-4167-b81f-283827bf337c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071860 May 30 12:08:06.275704 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 263/537] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:08:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:08:06.391135 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-458700ee-71c4-49a4-ba81-dcca0159a9ed tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:06.392265 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-458700ee-71c4-49a4-ba81-dcca0159a9ed tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] [instance: f99a1e0b-a450-43f6-82ca-32c64eac21b4] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:06.400536 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-458700ee-71c4-49a4-ba81-dcca0159a9ed tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:06.401316 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-458700ee-71c4-49a4-ba81-dcca0159a9ed tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:06.402368 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-458700ee-71c4-49a4-ba81-dcca0159a9ed tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:06.403009 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-458700ee-71c4-49a4-ba81-dcca0159a9ed tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:06.430804 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-458700ee-71c4-49a4-ba81-dcca0159a9ed tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] [instance: f99a1e0b-a450-43f6-82ca-32c64eac21b4] Going to try to terminate instance {{(pid=117670) delete /opt/stack/nova/nova/compute/api.py:2664}} May 30 12:08:06.434871 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-4ed664e7-0916-4f5c-9c72-5dee121d40e0 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:06.444982 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-4ed664e7-0916-4f5c-9c72-5dee121d40e0 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d" status: 200 len: 1737 microversion: 2.1 time: 0.197181 May 30 12:08:06.455902 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 275/538] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:08:06 2022] GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d => generated 1737 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:06.513079 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-458700ee-71c4-49a4-ba81-dcca0159a9ed tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] 10.222.0.32 "DELETE /compute/v2.1/servers/f99a1e0b-a450-43f6-82ca-32c64eac21b4" status: 204 len: 0 microversion: 2.1 time: 0.127006 May 30 12:08:06.513678 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 264/539] 10.222.0.32 () {58 vars in 1238 bytes} [Mon May 30 12:08:06 2022] DELETE /compute/v2.1/servers/f99a1e0b-a450-43f6-82ca-32c64eac21b4 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 30 12:08:06.521987 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-c6216bb1-e0aa-4e59-afa3-29762bf47859 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:06.522658 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-c6216bb1-e0aa-4e59-afa3-29762bf47859 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] [instance: f99a1e0b-a450-43f6-82ca-32c64eac21b4] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:06.528712 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c6216bb1-e0aa-4e59-afa3-29762bf47859 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:06.529164 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c6216bb1-e0aa-4e59-afa3-29762bf47859 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:06.530007 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c6216bb1-e0aa-4e59-afa3-29762bf47859 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:06.530446 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c6216bb1-e0aa-4e59-afa3-29762bf47859 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:06.563535 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-4d8f101d-1228-42a1-9165-a3621da0ca25 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:06.563750 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-4d8f101d-1228-42a1-9165-a3621da0ca25 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: 54ad4de0-2282-4baf-86a4-40d5ba1ba62a] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:06.570132 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4d8f101d-1228-42a1-9165-a3621da0ca25 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:06.570776 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4d8f101d-1228-42a1-9165-a3621da0ca25 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:06.571784 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4d8f101d-1228-42a1-9165-a3621da0ca25 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:06.572454 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4d8f101d-1228-42a1-9165-a3621da0ca25 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:06.611477 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4d8f101d-1228-42a1-9165-a3621da0ca25 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:06.620013 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4d8f101d-1228-42a1-9165-a3621da0ca25 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:06.620746 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.objects.instance [None req-4d8f101d-1228-42a1-9165-a3621da0ca25 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lazy-loading 'fault' on Instance uuid 54ad4de0-2282-4baf-86a4-40d5ba1ba62a {{(pid=117670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 30 12:08:06.693009 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-4d8f101d-1228-42a1-9165-a3621da0ca25 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7575179edbda45208561c983fc5b956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20763921c37c4e81bba702e09bf628b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:06.705042 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-c6216bb1-e0aa-4e59-afa3-29762bf47859 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4c83a1ccfc43beb3f48e4462b06794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cd1e0377594f52bb5bfa7159731d48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:06.705760 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-4d8f101d-1228-42a1-9165-a3621da0ca25 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a" status: 200 len: 1331 microversion: 2.1 time: 0.148468 May 30 12:08:06.706544 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 265/540] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:08:06 2022] GET /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a => generated 1331 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:08:06.713476 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-c6216bb1-e0aa-4e59-afa3-29762bf47859 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] 10.222.0.32 "GET /compute/v2.1/servers/f99a1e0b-a450-43f6-82ca-32c64eac21b4" status: 200 len: 1513 microversion: 2.1 time: 0.195625 May 30 12:08:06.714322 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 276/541] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:08:06 2022] GET /compute/v2.1/servers/f99a1e0b-a450-43f6-82ca-32c64eac21b4 => generated 1513 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:07.462162 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-e9af47ce-2829-47f9-aed3-59ff129b7260 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:07.462774 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-e9af47ce-2829-47f9-aed3-59ff129b7260 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 83f672fe-d699-4f70-bc26-74dced714a5d] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:07.469311 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e9af47ce-2829-47f9-aed3-59ff129b7260 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:07.469757 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e9af47ce-2829-47f9-aed3-59ff129b7260 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:07.470516 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e9af47ce-2829-47f9-aed3-59ff129b7260 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:07.471055 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e9af47ce-2829-47f9-aed3-59ff129b7260 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:07.605609 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-e9af47ce-2829-47f9-aed3-59ff129b7260 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:07.614149 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-e9af47ce-2829-47f9-aed3-59ff129b7260 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d" status: 200 len: 1737 microversion: 2.1 time: 0.156119 May 30 12:08:07.614717 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 266/542] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:08:07 2022] GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:07.722909 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-7603a8c7-a15b-4223-a259-e56fa13763ba tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:07.723525 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-7603a8c7-a15b-4223-a259-e56fa13763ba tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: 54ad4de0-2282-4baf-86a4-40d5ba1ba62a] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:07.730549 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-561f074d-d6e4-4063-b30e-5fbe1d8f94bd tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:07.731077 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7603a8c7-a15b-4223-a259-e56fa13763ba tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:07.731220 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-561f074d-d6e4-4063-b30e-5fbe1d8f94bd tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] [instance: f99a1e0b-a450-43f6-82ca-32c64eac21b4] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:07.731533 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7603a8c7-a15b-4223-a259-e56fa13763ba tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:07.732346 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7603a8c7-a15b-4223-a259-e56fa13763ba tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:07.732792 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7603a8c7-a15b-4223-a259-e56fa13763ba tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:07.737119 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-561f074d-d6e4-4063-b30e-5fbe1d8f94bd tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:07.737565 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-561f074d-d6e4-4063-b30e-5fbe1d8f94bd tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:07.738324 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-561f074d-d6e4-4063-b30e-5fbe1d8f94bd tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:07.738756 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-561f074d-d6e4-4063-b30e-5fbe1d8f94bd tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:07.763418 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7603a8c7-a15b-4223-a259-e56fa13763ba tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:07.763872 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7603a8c7-a15b-4223-a259-e56fa13763ba tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:07.764360 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.objects.instance [None req-7603a8c7-a15b-4223-a259-e56fa13763ba tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lazy-loading 'fault' on Instance uuid 54ad4de0-2282-4baf-86a4-40d5ba1ba62a {{(pid=117671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 30 12:08:07.825364 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-7603a8c7-a15b-4223-a259-e56fa13763ba tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7575179edbda45208561c983fc5b956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20763921c37c4e81bba702e09bf628b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:07.832962 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-7603a8c7-a15b-4223-a259-e56fa13763ba tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a" status: 200 len: 1331 microversion: 2.1 time: 0.113904 May 30 12:08:07.833544 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 277/543] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:08:07 2022] GET /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a => generated 1331 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:07.891892 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-561f074d-d6e4-4063-b30e-5fbe1d8f94bd tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4c83a1ccfc43beb3f48e4462b06794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cd1e0377594f52bb5bfa7159731d48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:07.901986 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-561f074d-d6e4-4063-b30e-5fbe1d8f94bd tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] 10.222.0.32 "GET /compute/v2.1/servers/f99a1e0b-a450-43f6-82ca-32c64eac21b4" status: 200 len: 1513 microversion: 2.1 time: 0.175136 May 30 12:08:07.902633 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 267/544] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:08:07 2022] GET /compute/v2.1/servers/f99a1e0b-a450-43f6-82ca-32c64eac21b4 => generated 1513 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:08:08.637214 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-9e564508-f72f-4eea-be95-cf67ed60336c tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:08.638388 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-9e564508-f72f-4eea-be95-cf67ed60336c tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 83f672fe-d699-4f70-bc26-74dced714a5d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:08.648318 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9e564508-f72f-4eea-be95-cf67ed60336c tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:08.648683 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9e564508-f72f-4eea-be95-cf67ed60336c tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:08.649461 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9e564508-f72f-4eea-be95-cf67ed60336c tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:08.649998 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9e564508-f72f-4eea-be95-cf67ed60336c tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:08.802119 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-9e564508-f72f-4eea-be95-cf67ed60336c tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:08.811503 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-9e564508-f72f-4eea-be95-cf67ed60336c tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d" status: 200 len: 1737 microversion: 2.1 time: 0.182895 May 30 12:08:08.812129 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 278/545] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:08:08 2022] GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d => generated 1737 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:08.851564 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-86164224-c82a-4150-86f5-001689ad4c89 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:08.852203 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-86164224-c82a-4150-86f5-001689ad4c89 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: 54ad4de0-2282-4baf-86a4-40d5ba1ba62a] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:08.858924 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-86164224-c82a-4150-86f5-001689ad4c89 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:08.859377 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-86164224-c82a-4150-86f5-001689ad4c89 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:08.860459 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-86164224-c82a-4150-86f5-001689ad4c89 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:08.860893 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-86164224-c82a-4150-86f5-001689ad4c89 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:08.876357 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.wsgi [None req-86164224-c82a-4150-86f5-001689ad4c89 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] HTTP exception thrown: Instance 54ad4de0-2282-4baf-86a4-40d5ba1ba62a could not be found. May 30 12:08:08.878101 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-86164224-c82a-4150-86f5-001689ad4c89 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Request method failure captured: May 30 12:08:08.878101 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: request: GET /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a HTTP/1.1 May 30 12:08:08.878101 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Accept: application/json May 30 12:08:08.878101 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Accept-Encoding: identity May 30 12:08:08.878101 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Connection: close May 30 12:08:08.878101 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Content-Length: 0 May 30 12:08:08.878101 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Content-Type: application/json May 30 12:08:08.878101 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Host: 10.222.0.32 May 30 12:08:08.878101 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Openstack-System-Scope: None May 30 12:08:08.878101 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: User-Agent: python-urllib3/1.26.9 May 30 12:08:08.878101 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Auth-Token: gAAAAABilLLAYcX6lTFc6UYhtte3qOfoT2D6p3xmrlj8lFSs8RM3SsxCJSweWMgYMCOyRE51N8YW3rSrU1JYG-ztTk5m_gEJkCNSzYatjS4LK9S2ataZ1OqgPb6zqIfN7SdtrBc2fQRHJMFEqwi_DhRkSGnSViHvbRwm6OQNgq1VdpWmApLUG3U May 30 12:08:08.878101 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Domain-Id: None May 30 12:08:08.878101 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Domain-Name: None May 30 12:08:08.878101 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Identity-Status: Confirmed May 30 12:08:08.878101 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Is-Admin-Project: True May 30 12:08:08.878101 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Domain-Id: default May 30 12:08:08.878101 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Domain-Name: Default May 30 12:08:08.878101 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Id: 20763921c37c4e81bba702e09bf628b2 May 30 12:08:08.878101 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Name: tempest-AttachVolumeNegativeTest-1368164951 May 30 12:08:08.878101 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Role: reader,member May 30 12:08:08.878101 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Roles: reader,member May 30 12:08:08.879439 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/20763921c37c4e81bba702e09bf628b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/20763921c37c4e81bba702e09bf628b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/20763921c37c4e81bba702e09bf628b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_20763921c37c4e81bba702e09bf628b2", "adminURL": "http://10.222.0.32:8080"}]}] May 30 12:08:08.879439 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant: tempest-AttachVolumeNegativeTest-1368164951 May 30 12:08:08.879439 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant-Id: 20763921c37c4e81bba702e09bf628b2 May 30 12:08:08.879439 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1368164951 May 30 12:08:08.879439 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User: tempest-AttachVolumeNegativeTest-1368164951-project May 30 12:08:08.879439 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Domain-Id: default May 30 12:08:08.879439 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Domain-Name: Default May 30 12:08:08.879439 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Id: 7575179edbda45208561c983fc5b956c May 30 12:08:08.879439 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Name: tempest-AttachVolumeNegativeTest-1368164951-project May 30 12:08:08.879439 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: method: > May 30 12:08:08.879439 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: exception: Instance 54ad4de0-2282-4baf-86a4-40d5ba1ba62a could not be found. May 30 12:08:08.879439 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: action_args: {'id': '54ad4de0-2282-4baf-86a4-40d5ba1ba62a'} May 30 12:08:08.880341 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:08:08.880341 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:08:08.880341 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:08:08.880341 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:08:08.880341 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:08:08.880341 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:08:08.880341 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:08:08.880341 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:08:08.880341 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:08:08.880341 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:08:08.880341 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54ad4de0-2282-4baf-86a4-40d5ba1ba62a could not be found. May 30 12:08:08.880341 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:08:08.880341 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:08:08.880341 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:08:08.880341 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:08:08.880341 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:08:08.880341 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:08:08.880341 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:08:08.880341 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:08:08.880341 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:08:08.881528 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:08:08.881528 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 30 12:08:08.881528 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 30 12:08:08.881528 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 30 12:08:08.881528 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 30 12:08:08.881528 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:08:08.881528 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:08:08.881528 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54ad4de0-2282-4baf-86a4-40d5ba1ba62a could not be found. May 30 12:08:08.881528 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:08:08.881528 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:08:08.881528 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:08:08.881528 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:08:08.881528 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:08:08.881528 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:08:08.881528 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:08:08.881528 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:08:08.881528 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54ad4de0-2282-4baf-86a4-40d5ba1ba62a could not be found. May 30 12:08:08.881528 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:08:08.882620 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-86164224-c82a-4150-86f5-001689ad4c89 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Returning 404 to user: Instance 54ad4de0-2282-4baf-86a4-40d5ba1ba62a could not be found. {{(pid=117670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:08:08.882620 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-86164224-c82a-4150-86f5-001689ad4c89 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a" status: 404 len: 111 microversion: 2.1 time: 0.032627 May 30 12:08:08.882620 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 268/546] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:08:08 2022] GET /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 30 12:08:08.888839 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-93746335-5d61-49ff-9261-8d20b165b398 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '.version_select at 0x7f0ef892ba60>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:08.909906 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-93746335-5d61-49ff-9261-8d20b165b398 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1295167922" status: 202 len: 0 microversion: 2.1 time: 0.024964 May 30 12:08:08.910568 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 279/547] 10.222.0.32 () {58 vars in 1220 bytes} [Mon May 30 12:08:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1295167922 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 30 12:08:08.921114 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-c1341ae3-2f5f-4ba1-bc3d-9188cc7361c6 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:08.921983 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-c1341ae3-2f5f-4ba1-bc3d-9188cc7361c6 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] [instance: f99a1e0b-a450-43f6-82ca-32c64eac21b4] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:08.930756 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c1341ae3-2f5f-4ba1-bc3d-9188cc7361c6 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:08.931502 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c1341ae3-2f5f-4ba1-bc3d-9188cc7361c6 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:08.932545 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c1341ae3-2f5f-4ba1-bc3d-9188cc7361c6 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:08.933157 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c1341ae3-2f5f-4ba1-bc3d-9188cc7361c6 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:08.962015 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:08:09.133856 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-c1341ae3-2f5f-4ba1-bc3d-9188cc7361c6 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4c83a1ccfc43beb3f48e4462b06794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94cd1e0377594f52bb5bfa7159731d48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:09.142317 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-c1341ae3-2f5f-4ba1-bc3d-9188cc7361c6 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] 10.222.0.32 "GET /compute/v2.1/servers/f99a1e0b-a450-43f6-82ca-32c64eac21b4" status: 200 len: 1513 microversion: 2.1 time: 0.225756 May 30 12:08:09.142986 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 269/548] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:08:08 2022] GET /compute/v2.1/servers/f99a1e0b-a450-43f6-82ca-32c64eac21b4 => generated 1513 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:09.371150 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-5d0e8c5f-70d4-4126-a289-35b31965ec36 req-857c5990-3092-46fb-a37b-510645d820f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f99a1e0b-a450-43f6-82ca-32c64eac21b4", "name": "network-vif-deleted", "tag": "0f672e22-24fe-42e6-ad6b-9c60ec54b09e"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:08:09.380476 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-5d0e8c5f-70d4-4126-a289-35b31965ec36 req-857c5990-3092-46fb-a37b-510645d820f7 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:09.380922 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-5d0e8c5f-70d4-4126-a289-35b31965ec36 req-857c5990-3092-46fb-a37b-510645d820f7 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:09.393706 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-5d0e8c5f-70d4-4126-a289-35b31965ec36 req-857c5990-3092-46fb-a37b-510645d820f7 service nova] Creating event network-vif-deleted:0f672e22-24fe-42e6-ad6b-9c60ec54b09e for instance f99a1e0b-a450-43f6-82ca-32c64eac21b4 on hv-cinder-84051 May 30 12:08:09.399492 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-5d0e8c5f-70d4-4126-a289-35b31965ec36 req-857c5990-3092-46fb-a37b-510645d820f7 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032108 May 30 12:08:09.400226 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 280/549] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:08:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:08:09.730152 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-2f547e61-bef6-4749-8f8f-7f940f04dd1e tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Action: 'create', calling method: .version_select at 0x7f0ef86ef040>, body: {"keypair": {"name": "tempest-keypair-1272056813", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD6HRTWvUn6Ar/71NmpN/dLxfo0ZpQHzr6z111uAXY2VWRrdq8+0euBUZW6iAp3ZKFmeSqxG8/67t3REelUxL3R6Ye8+j+dhihYefzKnKkeW4ShSYS3lDXkPKo9kU3Qs/g=="}} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:08:09.745867 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.quota [None req-2f547e61-bef6-4749-8f8f-7f940f04dd1e tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Getting quotas for project 20763921c37c4e81bba702e09bf628b2. Resources: {'key_pairs'} {{(pid=117670) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 30 12:08:09.749736 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.quota [None req-2f547e61-bef6-4749-8f8f-7f940f04dd1e tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Getting quotas for user 7575179edbda45208561c983fc5b956c and project 20763921c37c4e81bba702e09bf628b2. Resources: {'key_pairs'} {{(pid=117670) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 30 12:08:09.775304 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-2f547e61-bef6-4749-8f8f-7f940f04dd1e tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049759 May 30 12:08:09.775900 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 270/550] 10.222.0.32 () {60 vars in 1158 bytes} [Mon May 30 12:08:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:08:09.830647 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-f9d0652b-d2ff-4648-b01e-30d8807d29db tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:09.831368 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-f9d0652b-d2ff-4648-b01e-30d8807d29db tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 83f672fe-d699-4f70-bc26-74dced714a5d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:09.839478 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f9d0652b-d2ff-4648-b01e-30d8807d29db tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:09.839933 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f9d0652b-d2ff-4648-b01e-30d8807d29db tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:09.840745 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f9d0652b-d2ff-4648-b01e-30d8807d29db tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:09.841183 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f9d0652b-d2ff-4648-b01e-30d8807d29db tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:10.044712 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-f9d0652b-d2ff-4648-b01e-30d8807d29db tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:10.053378 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-f9d0652b-d2ff-4648-b01e-30d8807d29db tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d" status: 200 len: 1737 microversion: 2.1 time: 0.227447 May 30 12:08:10.054322 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 281/551] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:08:09 2022] GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d => generated 1737 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:10.161882 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-f3106a87-b833-4923-9b6e-96e707ddcea4 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:10.162420 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-f3106a87-b833-4923-9b6e-96e707ddcea4 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] [instance: f99a1e0b-a450-43f6-82ca-32c64eac21b4] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:10.168688 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f3106a87-b833-4923-9b6e-96e707ddcea4 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:10.169141 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f3106a87-b833-4923-9b6e-96e707ddcea4 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:10.169919 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f3106a87-b833-4923-9b6e-96e707ddcea4 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:10.170356 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f3106a87-b833-4923-9b6e-96e707ddcea4 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:10.183942 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.wsgi [None req-f3106a87-b833-4923-9b6e-96e707ddcea4 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] HTTP exception thrown: Instance f99a1e0b-a450-43f6-82ca-32c64eac21b4 could not be found. May 30 12:08:10.185551 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-f3106a87-b833-4923-9b6e-96e707ddcea4 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Request method failure captured: May 30 12:08:10.185551 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: request: GET /compute/v2.1/servers/f99a1e0b-a450-43f6-82ca-32c64eac21b4 HTTP/1.1 May 30 12:08:10.185551 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Accept: application/json May 30 12:08:10.185551 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Accept-Encoding: identity May 30 12:08:10.185551 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Connection: close May 30 12:08:10.185551 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Content-Length: 0 May 30 12:08:10.185551 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Content-Type: application/json May 30 12:08:10.185551 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Host: 10.222.0.32 May 30 12:08:10.185551 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Openstack-System-Scope: None May 30 12:08:10.185551 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: User-Agent: python-urllib3/1.26.9 May 30 12:08:10.185551 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Auth-Token: gAAAAABilLM0m5m8cr0UeAGDxFlkQLqhfCwYUzq4oH0C831uP9ByBJIelv18XA1AwqxgJ0rrfNfU-hxdXFP6_pRrxkFqJuQ1MzOQ4fyypIUOOZhdxzE9NUhguCBb9DNxEYfz9ndBB7H3RZrH2NQfkW2UtmGp2OHSj9poPwoAev7UW0JwXi30_Hs May 30 12:08:10.185551 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Domain-Id: None May 30 12:08:10.185551 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Domain-Name: None May 30 12:08:10.185551 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Identity-Status: Confirmed May 30 12:08:10.185551 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Is-Admin-Project: True May 30 12:08:10.185551 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Domain-Id: default May 30 12:08:10.185551 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Domain-Name: Default May 30 12:08:10.185551 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Id: 94cd1e0377594f52bb5bfa7159731d48 May 30 12:08:10.185551 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1260741086 May 30 12:08:10.185551 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Role: reader,member May 30 12:08:10.185551 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Roles: reader,member May 30 12:08:10.187086 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/94cd1e0377594f52bb5bfa7159731d48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/94cd1e0377594f52bb5bfa7159731d48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/94cd1e0377594f52bb5bfa7159731d48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_94cd1e0377594f52bb5bfa7159731d48", "adminURL": "http://10.222.0.32:8080"}]}] May 30 12:08:10.187086 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant: tempest-VolumesSnapshotTestJSON-1260741086 May 30 12:08:10.187086 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant-Id: 94cd1e0377594f52bb5bfa7159731d48 May 30 12:08:10.187086 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1260741086 May 30 12:08:10.187086 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User: tempest-VolumesSnapshotTestJSON-1260741086-project May 30 12:08:10.187086 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Domain-Id: default May 30 12:08:10.187086 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Domain-Name: Default May 30 12:08:10.187086 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Id: 1d4c83a1ccfc43beb3f48e4462b06794 May 30 12:08:10.187086 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Name: tempest-VolumesSnapshotTestJSON-1260741086-project May 30 12:08:10.187086 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: method: > May 30 12:08:10.187086 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: exception: Instance f99a1e0b-a450-43f6-82ca-32c64eac21b4 could not be found. May 30 12:08:10.187086 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: action_args: {'id': 'f99a1e0b-a450-43f6-82ca-32c64eac21b4'} May 30 12:08:10.187973 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:08:10.187973 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:08:10.187973 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:08:10.187973 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:08:10.187973 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:08:10.187973 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:08:10.187973 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:08:10.187973 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:08:10.187973 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:08:10.187973 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:08:10.187973 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f99a1e0b-a450-43f6-82ca-32c64eac21b4 could not be found. May 30 12:08:10.187973 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:08:10.187973 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:08:10.187973 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:08:10.187973 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:08:10.187973 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:08:10.187973 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:08:10.187973 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:08:10.187973 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:08:10.187973 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:08:10.189420 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:08:10.189420 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 30 12:08:10.189420 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 30 12:08:10.189420 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 30 12:08:10.189420 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 30 12:08:10.189420 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:08:10.189420 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:08:10.189420 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f99a1e0b-a450-43f6-82ca-32c64eac21b4 could not be found. May 30 12:08:10.189420 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:08:10.189420 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:08:10.189420 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:08:10.189420 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:08:10.189420 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:08:10.189420 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:08:10.189420 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:08:10.189420 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:08:10.189420 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f99a1e0b-a450-43f6-82ca-32c64eac21b4 could not be found. May 30 12:08:10.189420 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:08:10.190519 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-f3106a87-b833-4923-9b6e-96e707ddcea4 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] Returning 404 to user: Instance f99a1e0b-a450-43f6-82ca-32c64eac21b4 could not be found. {{(pid=117670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:08:10.190519 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-f3106a87-b833-4923-9b6e-96e707ddcea4 tempest-VolumesSnapshotTestJSON-1260741086 tempest-VolumesSnapshotTestJSON-1260741086-project] 10.222.0.32 "GET /compute/v2.1/servers/f99a1e0b-a450-43f6-82ca-32c64eac21b4" status: 404 len: 111 microversion: 2.1 time: 0.029857 May 30 12:08:10.190519 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 271/552] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:08:10 2022] GET /compute/v2.1/servers/f99a1e0b-a450-43f6-82ca-32c64eac21b4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 30 12:08:11.071058 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-c08f9259-dddf-4604-97e1-42356536ba52 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:11.071710 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-c08f9259-dddf-4604-97e1-42356536ba52 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 83f672fe-d699-4f70-bc26-74dced714a5d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:11.078500 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c08f9259-dddf-4604-97e1-42356536ba52 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:11.078957 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c08f9259-dddf-4604-97e1-42356536ba52 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:11.079736 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c08f9259-dddf-4604-97e1-42356536ba52 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:11.080194 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c08f9259-dddf-4604-97e1-42356536ba52 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:11.140240 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-d3c9f5d3-afd5-4272-a560-860f9090b16d tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1801834075", "imageRef": "b8ef93ed-af98-4d8c-9e1d-43d7b1f2b832", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "910909fe-c0b0-4c8d-8e4c-a23ea4b0eddd"}], "security_groups": [{"name": "tempest-securitygroup--237638282"}], "key_name": "tempest-keypair-1272056813", "user_data": "}} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:08:11.220003 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-c08f9259-dddf-4604-97e1-42356536ba52 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:11.229776 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-c08f9259-dddf-4604-97e1-42356536ba52 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d" status: 200 len: 1737 microversion: 2.1 time: 0.163095 May 30 12:08:11.230376 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 282/553] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:08:11 2022] GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d => generated 1737 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:11.258853 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.network.neutron [None req-d3c9f5d3-afd5-4272-a560-860f9090b16d tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] validate_networks() for [('910909fe-c0b0-4c8d-8e4c-a23ea4b0eddd', None, None, None, None, None)] {{(pid=117670) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 30 12:08:11.635038 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-d3c9f5d3-afd5-4272-a560-860f9090b16d tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Flavor limits 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 30 12:08:11.635456 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-d3c9f5d3-afd5-4272-a560-860f9090b16d tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Image limits 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 30 12:08:11.636018 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-d3c9f5d3-afd5-4272-a560-860f9090b16d tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Flavor pref 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 30 12:08:11.636458 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-d3c9f5d3-afd5-4272-a560-860f9090b16d tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Image pref 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 30 12:08:11.636863 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-d3c9f5d3-afd5-4272-a560-860f9090b16d tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 30 12:08:11.647068 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d3c9f5d3-afd5-4272-a560-860f9090b16d tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:11.647898 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d3c9f5d3-afd5-4272-a560-860f9090b16d tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:11.650102 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d3c9f5d3-afd5-4272-a560-860f9090b16d tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:11.650542 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d3c9f5d3-afd5-4272-a560-860f9090b16d tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:11.669001 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.quota [None req-d3c9f5d3-afd5-4272-a560-860f9090b16d tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Getting quotas for project 20763921c37c4e81bba702e09bf628b2. Resources: {'cores', 'instances', 'ram'} {{(pid=117670) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 30 12:08:11.673448 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.quota [None req-d3c9f5d3-afd5-4272-a560-860f9090b16d tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Getting quotas for user 7575179edbda45208561c983fc5b956c and project 20763921c37c4e81bba702e09bf628b2. Resources: {'cores', 'instances', 'ram'} {{(pid=117670) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 30 12:08:11.692716 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-d3c9f5d3-afd5-4272-a560-860f9090b16d tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Going to run 1 instances... {{(pid=117670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 30 12:08:11.692716 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-d3c9f5d3-afd5-4272-a560-860f9090b16d tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: ed036712-bf1c-4eaa-9736-b486dc1f76bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b8ef93ed-af98-4d8c-9e1d-43d7b1f2b832',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 30 12:08:11.739759 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-d3c9f5d3-afd5-4272-a560-860f9090b16d tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.603833 May 30 12:08:11.741352 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 272/554] 10.222.0.32 () {60 vars in 1146 bytes} [Mon May 30 12:08:11 2022] POST /compute/v2.1/servers => generated 401 bytes in 605 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 30 12:08:11.750920 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-505b8138-9ee6-42f0-b691-89fecbad66a5 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:11.751534 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-505b8138-9ee6-42f0-b691-89fecbad66a5 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: ed036712-bf1c-4eaa-9736-b486dc1f76bf] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:11.811914 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-505b8138-9ee6-42f0-b691-89fecbad66a5 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7575179edbda45208561c983fc5b956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20763921c37c4e81bba702e09bf628b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:11.818853 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-505b8138-9ee6-42f0-b691-89fecbad66a5 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/ed036712-bf1c-4eaa-9736-b486dc1f76bf" status: 200 len: 1242 microversion: 2.1 time: 0.071768 May 30 12:08:11.819544 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 283/555] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:08:11 2022] GET /compute/v2.1/servers/ed036712-bf1c-4eaa-9736-b486dc1f76bf => generated 1242 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:12.248178 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-d9f6daec-c3be-45a0-89b5-319d5429e331 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:12.248727 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-d9f6daec-c3be-45a0-89b5-319d5429e331 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 83f672fe-d699-4f70-bc26-74dced714a5d] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:12.254903 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d9f6daec-c3be-45a0-89b5-319d5429e331 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:12.255372 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d9f6daec-c3be-45a0-89b5-319d5429e331 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:12.256131 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d9f6daec-c3be-45a0-89b5-319d5429e331 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:12.257144 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d9f6daec-c3be-45a0-89b5-319d5429e331 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:12.386446 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-d9f6daec-c3be-45a0-89b5-319d5429e331 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:12.394922 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-d9f6daec-c3be-45a0-89b5-319d5429e331 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d" status: 200 len: 1737 microversion: 2.1 time: 0.151316 May 30 12:08:12.395513 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 273/556] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:08:12 2022] GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:12.835896 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-58bf6784-1c77-4237-a9f1-f6c0d89bd238 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:12.836513 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-58bf6784-1c77-4237-a9f1-f6c0d89bd238 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: ed036712-bf1c-4eaa-9736-b486dc1f76bf] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:12.843077 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-58bf6784-1c77-4237-a9f1-f6c0d89bd238 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:12.843465 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-58bf6784-1c77-4237-a9f1-f6c0d89bd238 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:12.844267 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-58bf6784-1c77-4237-a9f1-f6c0d89bd238 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:12.844705 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-58bf6784-1c77-4237-a9f1-f6c0d89bd238 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:12.905862 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-58bf6784-1c77-4237-a9f1-f6c0d89bd238 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7575179edbda45208561c983fc5b956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20763921c37c4e81bba702e09bf628b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:12.913572 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-58bf6784-1c77-4237-a9f1-f6c0d89bd238 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/ed036712-bf1c-4eaa-9736-b486dc1f76bf" status: 200 len: 1246 microversion: 2.1 time: 0.081230 May 30 12:08:12.914161 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 284/557] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:08:12 2022] GET /compute/v2.1/servers/ed036712-bf1c-4eaa-9736-b486dc1f76bf => generated 1246 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:13.411991 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-7da06cc9-8e09-4116-8b4c-9025ecfcb572 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:13.413390 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-7da06cc9-8e09-4116-8b4c-9025ecfcb572 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 83f672fe-d699-4f70-bc26-74dced714a5d] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:13.420205 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7da06cc9-8e09-4116-8b4c-9025ecfcb572 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:13.420876 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7da06cc9-8e09-4116-8b4c-9025ecfcb572 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:13.421707 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7da06cc9-8e09-4116-8b4c-9025ecfcb572 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:13.422423 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7da06cc9-8e09-4116-8b4c-9025ecfcb572 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:13.557659 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-7da06cc9-8e09-4116-8b4c-9025ecfcb572 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:13.566005 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-7da06cc9-8e09-4116-8b4c-9025ecfcb572 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d" status: 200 len: 1737 microversion: 2.1 time: 0.157870 May 30 12:08:13.566578 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 274/558] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:08:13 2022] GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:13.930271 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-bbe3ff6c-a50e-491c-8d88-c4b5d82042d8 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:13.930886 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-bbe3ff6c-a50e-491c-8d88-c4b5d82042d8 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: ed036712-bf1c-4eaa-9736-b486dc1f76bf] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:13.933549 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:08:13.939100 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-bbe3ff6c-a50e-491c-8d88-c4b5d82042d8 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:13.939556 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-bbe3ff6c-a50e-491c-8d88-c4b5d82042d8 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:13.940371 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-bbe3ff6c-a50e-491c-8d88-c4b5d82042d8 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:13.940810 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-bbe3ff6c-a50e-491c-8d88-c4b5d82042d8 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:14.002963 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-bbe3ff6c-a50e-491c-8d88-c4b5d82042d8 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7575179edbda45208561c983fc5b956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20763921c37c4e81bba702e09bf628b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:14.010946 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-bbe3ff6c-a50e-491c-8d88-c4b5d82042d8 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/ed036712-bf1c-4eaa-9736-b486dc1f76bf" status: 200 len: 1238 microversion: 2.1 time: 0.084527 May 30 12:08:14.011515 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 285/559] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:08:13 2022] GET /compute/v2.1/servers/ed036712-bf1c-4eaa-9736-b486dc1f76bf => generated 1238 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:14.583440 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-9617a3d8-c0cc-4d3f-86e8-ce920323ea83 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:14.584043 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-9617a3d8-c0cc-4d3f-86e8-ce920323ea83 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 83f672fe-d699-4f70-bc26-74dced714a5d] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:14.591606 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9617a3d8-c0cc-4d3f-86e8-ce920323ea83 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:14.592068 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9617a3d8-c0cc-4d3f-86e8-ce920323ea83 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:14.592850 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9617a3d8-c0cc-4d3f-86e8-ce920323ea83 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:14.593674 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9617a3d8-c0cc-4d3f-86e8-ce920323ea83 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:14.730097 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-9617a3d8-c0cc-4d3f-86e8-ce920323ea83 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:14.738279 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-9617a3d8-c0cc-4d3f-86e8-ce920323ea83 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d" status: 200 len: 1737 microversion: 2.1 time: 0.158792 May 30 12:08:14.738842 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 275/560] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:08:14 2022] GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:15.029333 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-ce9bc11d-a93e-4d07-a0ca-0daff791fc62 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:15.030719 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-ce9bc11d-a93e-4d07-a0ca-0daff791fc62 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: ed036712-bf1c-4eaa-9736-b486dc1f76bf] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:15.039031 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ce9bc11d-a93e-4d07-a0ca-0daff791fc62 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:15.039701 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ce9bc11d-a93e-4d07-a0ca-0daff791fc62 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:15.040675 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ce9bc11d-a93e-4d07-a0ca-0daff791fc62 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:15.041264 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ce9bc11d-a93e-4d07-a0ca-0daff791fc62 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:15.126026 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-ce9bc11d-a93e-4d07-a0ca-0daff791fc62 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7575179edbda45208561c983fc5b956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20763921c37c4e81bba702e09bf628b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:15.135843 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-ce9bc11d-a93e-4d07-a0ca-0daff791fc62 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/ed036712-bf1c-4eaa-9736-b486dc1f76bf" status: 200 len: 1302 microversion: 2.1 time: 0.111643 May 30 12:08:15.146224 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 286/561] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:08:15 2022] GET /compute/v2.1/servers/ed036712-bf1c-4eaa-9736-b486dc1f76bf => generated 1302 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:15.756112 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-ae672943-ecdb-40b6-9c00-7a3e7c6d1e1b tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:15.756964 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-ae672943-ecdb-40b6-9c00-7a3e7c6d1e1b tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 83f672fe-d699-4f70-bc26-74dced714a5d] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:15.763374 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ae672943-ecdb-40b6-9c00-7a3e7c6d1e1b tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:15.763818 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ae672943-ecdb-40b6-9c00-7a3e7c6d1e1b tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:15.764610 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ae672943-ecdb-40b6-9c00-7a3e7c6d1e1b tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:15.765042 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ae672943-ecdb-40b6-9c00-7a3e7c6d1e1b tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:15.917665 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-ae672943-ecdb-40b6-9c00-7a3e7c6d1e1b tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:15.928801 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-ae672943-ecdb-40b6-9c00-7a3e7c6d1e1b tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d" status: 200 len: 1737 microversion: 2.1 time: 0.175851 May 30 12:08:15.929425 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 276/562] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:08:15 2022] GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d => generated 1737 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:16.154526 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-3e57d047-802c-4ab8-9a16-4e12e64bb75a tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:16.155134 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-3e57d047-802c-4ab8-9a16-4e12e64bb75a tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: ed036712-bf1c-4eaa-9736-b486dc1f76bf] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:16.163115 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3e57d047-802c-4ab8-9a16-4e12e64bb75a tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:16.163884 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3e57d047-802c-4ab8-9a16-4e12e64bb75a tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:16.164721 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3e57d047-802c-4ab8-9a16-4e12e64bb75a tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:16.165157 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3e57d047-802c-4ab8-9a16-4e12e64bb75a tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:16.311549 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-3e57d047-802c-4ab8-9a16-4e12e64bb75a tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7575179edbda45208561c983fc5b956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20763921c37c4e81bba702e09bf628b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:16.320542 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-3e57d047-802c-4ab8-9a16-4e12e64bb75a tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/ed036712-bf1c-4eaa-9736-b486dc1f76bf" status: 200 len: 1367 microversion: 2.1 time: 0.169832 May 30 12:08:16.321883 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 287/563] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:08:16 2022] GET /compute/v2.1/servers/ed036712-bf1c-4eaa-9736-b486dc1f76bf => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:16.583778 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-1975d04a-3f8c-4a3d-944d-c4b8146f39db req-cdfb2463-56cc-4d76-9bd9-b1d2b3899b7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed036712-bf1c-4eaa-9736-b486dc1f76bf", "tag": "4e970db9-1999-42dc-98dc-b12c5dd44b3f"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:08:16.622314 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-1975d04a-3f8c-4a3d-944d-c4b8146f39db req-cdfb2463-56cc-4d76-9bd9-b1d2b3899b7d service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:16.622756 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-1975d04a-3f8c-4a3d-944d-c4b8146f39db req-cdfb2463-56cc-4d76-9bd9-b1d2b3899b7d service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:16.636545 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-1975d04a-3f8c-4a3d-944d-c4b8146f39db req-cdfb2463-56cc-4d76-9bd9-b1d2b3899b7d service nova] Creating event network-changed:4e970db9-1999-42dc-98dc-b12c5dd44b3f for instance ed036712-bf1c-4eaa-9736-b486dc1f76bf on hv-cinder-84051 May 30 12:08:16.642243 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-1975d04a-3f8c-4a3d-944d-c4b8146f39db req-cdfb2463-56cc-4d76-9bd9-b1d2b3899b7d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062165 May 30 12:08:16.643160 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 277/564] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:08:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:08:16.945332 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-44725566-acb5-474b-be4a-cc5ec1bf70d3 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:16.945958 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-44725566-acb5-474b-be4a-cc5ec1bf70d3 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 83f672fe-d699-4f70-bc26-74dced714a5d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:16.952198 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-44725566-acb5-474b-be4a-cc5ec1bf70d3 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:16.952660 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-44725566-acb5-474b-be4a-cc5ec1bf70d3 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:16.953436 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-44725566-acb5-474b-be4a-cc5ec1bf70d3 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:16.953877 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-44725566-acb5-474b-be4a-cc5ec1bf70d3 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:17.086627 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-44725566-acb5-474b-be4a-cc5ec1bf70d3 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:17.094797 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-44725566-acb5-474b-be4a-cc5ec1bf70d3 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d" status: 200 len: 1737 microversion: 2.1 time: 0.153566 May 30 12:08:17.095361 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 288/565] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:08:16 2022] GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:17.339448 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-7f8ede9d-a49f-4bc6-829b-d6c86e32d211 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:17.340185 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-7f8ede9d-a49f-4bc6-829b-d6c86e32d211 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: ed036712-bf1c-4eaa-9736-b486dc1f76bf] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:17.346464 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7f8ede9d-a49f-4bc6-829b-d6c86e32d211 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:17.346914 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7f8ede9d-a49f-4bc6-829b-d6c86e32d211 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:17.347676 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7f8ede9d-a49f-4bc6-829b-d6c86e32d211 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:17.348106 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7f8ede9d-a49f-4bc6-829b-d6c86e32d211 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:17.480022 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-7f8ede9d-a49f-4bc6-829b-d6c86e32d211 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7575179edbda45208561c983fc5b956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20763921c37c4e81bba702e09bf628b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:17.487613 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-7f8ede9d-a49f-4bc6-829b-d6c86e32d211 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/ed036712-bf1c-4eaa-9736-b486dc1f76bf" status: 200 len: 1367 microversion: 2.1 time: 0.153399 May 30 12:08:17.488190 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 278/566] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:08:17 2022] GET /compute/v2.1/servers/ed036712-bf1c-4eaa-9736-b486dc1f76bf => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:18.111769 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-2a3ec05d-8da0-479f-8e42-57f7e55d3b03 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:18.112441 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-2a3ec05d-8da0-479f-8e42-57f7e55d3b03 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 83f672fe-d699-4f70-bc26-74dced714a5d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:18.121243 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2a3ec05d-8da0-479f-8e42-57f7e55d3b03 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:18.121697 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2a3ec05d-8da0-479f-8e42-57f7e55d3b03 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:18.122481 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2a3ec05d-8da0-479f-8e42-57f7e55d3b03 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:18.122920 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2a3ec05d-8da0-479f-8e42-57f7e55d3b03 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:18.263208 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-2a3ec05d-8da0-479f-8e42-57f7e55d3b03 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:18.272806 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-2a3ec05d-8da0-479f-8e42-57f7e55d3b03 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d" status: 200 len: 1737 microversion: 2.1 time: 0.164887 May 30 12:08:18.273630 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 289/567] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:08:18 2022] GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d => generated 1737 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:18.504588 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-726ae5c8-1ee1-42dd-9292-00f4d8c8617d tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:18.505229 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-726ae5c8-1ee1-42dd-9292-00f4d8c8617d tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: ed036712-bf1c-4eaa-9736-b486dc1f76bf] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:18.512521 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-726ae5c8-1ee1-42dd-9292-00f4d8c8617d tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:18.512978 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-726ae5c8-1ee1-42dd-9292-00f4d8c8617d tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:18.513758 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-726ae5c8-1ee1-42dd-9292-00f4d8c8617d tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:18.514197 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-726ae5c8-1ee1-42dd-9292-00f4d8c8617d tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:18.657063 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-726ae5c8-1ee1-42dd-9292-00f4d8c8617d tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7575179edbda45208561c983fc5b956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20763921c37c4e81bba702e09bf628b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:18.664840 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-726ae5c8-1ee1-42dd-9292-00f4d8c8617d tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/ed036712-bf1c-4eaa-9736-b486dc1f76bf" status: 200 len: 1367 microversion: 2.1 time: 0.164207 May 30 12:08:18.665400 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 279/568] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:08:18 2022] GET /compute/v2.1/servers/ed036712-bf1c-4eaa-9736-b486dc1f76bf => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:19.290765 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-10cfdaf7-d262-4277-982d-8dad1beb53a6 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:19.291385 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-10cfdaf7-d262-4277-982d-8dad1beb53a6 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 83f672fe-d699-4f70-bc26-74dced714a5d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:19.300728 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-10cfdaf7-d262-4277-982d-8dad1beb53a6 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:19.301408 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-10cfdaf7-d262-4277-982d-8dad1beb53a6 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:19.302596 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-10cfdaf7-d262-4277-982d-8dad1beb53a6 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:19.303936 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-10cfdaf7-d262-4277-982d-8dad1beb53a6 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:19.433993 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-10cfdaf7-d262-4277-982d-8dad1beb53a6 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:19.442221 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-10cfdaf7-d262-4277-982d-8dad1beb53a6 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d" status: 200 len: 1737 microversion: 2.1 time: 0.155840 May 30 12:08:19.442797 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 290/569] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:08:19 2022] GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:19.681481 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-7161f289-f705-43e7-b5a8-aea5072f6244 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:19.682088 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-7161f289-f705-43e7-b5a8-aea5072f6244 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: ed036712-bf1c-4eaa-9736-b486dc1f76bf] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:19.688642 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7161f289-f705-43e7-b5a8-aea5072f6244 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:19.689100 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7161f289-f705-43e7-b5a8-aea5072f6244 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:19.689874 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7161f289-f705-43e7-b5a8-aea5072f6244 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:19.690314 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7161f289-f705-43e7-b5a8-aea5072f6244 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:19.822575 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-7161f289-f705-43e7-b5a8-aea5072f6244 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7575179edbda45208561c983fc5b956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20763921c37c4e81bba702e09bf628b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:19.829964 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-7161f289-f705-43e7-b5a8-aea5072f6244 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/ed036712-bf1c-4eaa-9736-b486dc1f76bf" status: 200 len: 1367 microversion: 2.1 time: 0.152410 May 30 12:08:19.830534 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 280/570] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:08:19 2022] GET /compute/v2.1/servers/ed036712-bf1c-4eaa-9736-b486dc1f76bf => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:20.460563 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-5a3d1831-6ec0-44b4-aeeb-a5094b661814 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:20.461153 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-5a3d1831-6ec0-44b4-aeeb-a5094b661814 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 83f672fe-d699-4f70-bc26-74dced714a5d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:20.467975 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5a3d1831-6ec0-44b4-aeeb-a5094b661814 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:20.468457 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5a3d1831-6ec0-44b4-aeeb-a5094b661814 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:20.469228 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5a3d1831-6ec0-44b4-aeeb-a5094b661814 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:20.469659 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5a3d1831-6ec0-44b4-aeeb-a5094b661814 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:20.627315 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-5a3d1831-6ec0-44b4-aeeb-a5094b661814 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:20.636334 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-5a3d1831-6ec0-44b4-aeeb-a5094b661814 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d" status: 200 len: 1737 microversion: 2.1 time: 0.180068 May 30 12:08:20.636975 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 291/571] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:08:20 2022] GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d => generated 1737 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:20.847220 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-491e8ff8-d046-4926-8018-75367dad13cc tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:20.847808 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-491e8ff8-d046-4926-8018-75367dad13cc tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: ed036712-bf1c-4eaa-9736-b486dc1f76bf] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:20.854928 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-491e8ff8-d046-4926-8018-75367dad13cc tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:20.855705 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-491e8ff8-d046-4926-8018-75367dad13cc tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:20.857069 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-491e8ff8-d046-4926-8018-75367dad13cc tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:20.857661 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-491e8ff8-d046-4926-8018-75367dad13cc tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:21.012140 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-491e8ff8-d046-4926-8018-75367dad13cc tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7575179edbda45208561c983fc5b956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20763921c37c4e81bba702e09bf628b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:21.020399 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-491e8ff8-d046-4926-8018-75367dad13cc tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/ed036712-bf1c-4eaa-9736-b486dc1f76bf" status: 200 len: 1367 microversion: 2.1 time: 0.177029 May 30 12:08:21.028723 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 281/572] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:08:20 2022] GET /compute/v2.1/servers/ed036712-bf1c-4eaa-9736-b486dc1f76bf => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:21.655374 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-686e67b3-1030-4f50-ac62-64b4ed52db17 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:21.655991 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-686e67b3-1030-4f50-ac62-64b4ed52db17 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 83f672fe-d699-4f70-bc26-74dced714a5d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:21.663628 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-686e67b3-1030-4f50-ac62-64b4ed52db17 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:21.664081 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-686e67b3-1030-4f50-ac62-64b4ed52db17 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:21.664879 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-686e67b3-1030-4f50-ac62-64b4ed52db17 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:21.665318 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-686e67b3-1030-4f50-ac62-64b4ed52db17 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:21.667889 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:08:21.796212 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-686e67b3-1030-4f50-ac62-64b4ed52db17 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:21.804431 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-686e67b3-1030-4f50-ac62-64b4ed52db17 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d" status: 200 len: 1737 microversion: 2.1 time: 0.152882 May 30 12:08:21.805005 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 292/573] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:08:21 2022] GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:22.042300 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-e4e14403-f603-4b44-8a5d-4ceb8911782c tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:22.043014 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-e4e14403-f603-4b44-8a5d-4ceb8911782c tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: ed036712-bf1c-4eaa-9736-b486dc1f76bf] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:22.045126 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell0:SELECT=2 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:08:22.045857 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell0:SELECT=10 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:08:22.053497 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e4e14403-f603-4b44-8a5d-4ceb8911782c tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:22.054160 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e4e14403-f603-4b44-8a5d-4ceb8911782c tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:22.055702 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e4e14403-f603-4b44-8a5d-4ceb8911782c tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:22.056169 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e4e14403-f603-4b44-8a5d-4ceb8911782c tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:22.193477 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-e4e14403-f603-4b44-8a5d-4ceb8911782c tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7575179edbda45208561c983fc5b956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20763921c37c4e81bba702e09bf628b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:22.201049 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-e4e14403-f603-4b44-8a5d-4ceb8911782c tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/ed036712-bf1c-4eaa-9736-b486dc1f76bf" status: 200 len: 1367 microversion: 2.1 time: 0.163748 May 30 12:08:22.201611 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 282/574] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:08:22 2022] GET /compute/v2.1/servers/ed036712-bf1c-4eaa-9736-b486dc1f76bf => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:22.821632 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-93313833-f0a3-4530-9bf9-a870609c8de7 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:22.822270 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-93313833-f0a3-4530-9bf9-a870609c8de7 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 83f672fe-d699-4f70-bc26-74dced714a5d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:22.824103 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell0:SELECT=2 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:08:22.829899 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-93313833-f0a3-4530-9bf9-a870609c8de7 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:22.830346 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-93313833-f0a3-4530-9bf9-a870609c8de7 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:22.831115 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-93313833-f0a3-4530-9bf9-a870609c8de7 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:22.831577 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-93313833-f0a3-4530-9bf9-a870609c8de7 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:22.960920 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-93313833-f0a3-4530-9bf9-a870609c8de7 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:22.968881 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-93313833-f0a3-4530-9bf9-a870609c8de7 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d" status: 200 len: 1737 microversion: 2.1 time: 0.151407 May 30 12:08:22.969444 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 293/575] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:08:22 2022] GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:23.217899 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-ba44155f-107e-4298-92a8-c3ca42150113 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:23.218521 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-ba44155f-107e-4298-92a8-c3ca42150113 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: ed036712-bf1c-4eaa-9736-b486dc1f76bf] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:23.227125 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ba44155f-107e-4298-92a8-c3ca42150113 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:23.227703 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ba44155f-107e-4298-92a8-c3ca42150113 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:23.228765 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ba44155f-107e-4298-92a8-c3ca42150113 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:23.229375 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ba44155f-107e-4298-92a8-c3ca42150113 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:23.370732 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-ba44155f-107e-4298-92a8-c3ca42150113 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7575179edbda45208561c983fc5b956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20763921c37c4e81bba702e09bf628b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:23.379907 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-ba44155f-107e-4298-92a8-c3ca42150113 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/ed036712-bf1c-4eaa-9736-b486dc1f76bf" status: 200 len: 1367 microversion: 2.1 time: 0.166002 May 30 12:08:23.381291 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 283/576] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:08:23 2022] GET /compute/v2.1/servers/ed036712-bf1c-4eaa-9736-b486dc1f76bf => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:23.503053 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-1d70a42f-ec33-4603-96a7-46ef0e5ba427 req-8d8c9bd8-cc4b-46a0-9a64-20e09f550a9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed036712-bf1c-4eaa-9736-b486dc1f76bf", "name": "network-vif-plugged", "status": "completed", "tag": "4e970db9-1999-42dc-98dc-b12c5dd44b3f"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:08:23.513367 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-1d70a42f-ec33-4603-96a7-46ef0e5ba427 req-8d8c9bd8-cc4b-46a0-9a64-20e09f550a9a service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:23.513814 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-1d70a42f-ec33-4603-96a7-46ef0e5ba427 req-8d8c9bd8-cc4b-46a0-9a64-20e09f550a9a service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:23.526221 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-1d70a42f-ec33-4603-96a7-46ef0e5ba427 req-8d8c9bd8-cc4b-46a0-9a64-20e09f550a9a service nova] Creating event network-vif-plugged:4e970db9-1999-42dc-98dc-b12c5dd44b3f for instance ed036712-bf1c-4eaa-9736-b486dc1f76bf on hv-cinder-84051 May 30 12:08:23.531435 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-1d70a42f-ec33-4603-96a7-46ef0e5ba427 req-8d8c9bd8-cc4b-46a0-9a64-20e09f550a9a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033072 May 30 12:08:23.532371 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 294/577] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:08:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 30 12:08:23.986813 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-5bb18d5c-2435-4743-8422-eb08f4002401 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:23.987343 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-5bb18d5c-2435-4743-8422-eb08f4002401 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 83f672fe-d699-4f70-bc26-74dced714a5d] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:23.996380 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5bb18d5c-2435-4743-8422-eb08f4002401 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:23.996852 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5bb18d5c-2435-4743-8422-eb08f4002401 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:23.997688 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5bb18d5c-2435-4743-8422-eb08f4002401 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:23.998130 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5bb18d5c-2435-4743-8422-eb08f4002401 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:24.135626 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-5bb18d5c-2435-4743-8422-eb08f4002401 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:24.143830 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-5bb18d5c-2435-4743-8422-eb08f4002401 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d" status: 200 len: 1737 microversion: 2.1 time: 0.160978 May 30 12:08:24.144729 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 284/578] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:08:23 2022] GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:24.400695 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-a7474522-48f1-4bc5-844e-1efad9439ed1 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:24.401418 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-a7474522-48f1-4bc5-844e-1efad9439ed1 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: ed036712-bf1c-4eaa-9736-b486dc1f76bf] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:24.407601 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a7474522-48f1-4bc5-844e-1efad9439ed1 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:24.408056 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a7474522-48f1-4bc5-844e-1efad9439ed1 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:24.408839 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a7474522-48f1-4bc5-844e-1efad9439ed1 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:24.409282 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a7474522-48f1-4bc5-844e-1efad9439ed1 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:24.544775 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-a7474522-48f1-4bc5-844e-1efad9439ed1 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7575179edbda45208561c983fc5b956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20763921c37c4e81bba702e09bf628b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:24.552416 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-a7474522-48f1-4bc5-844e-1efad9439ed1 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/ed036712-bf1c-4eaa-9736-b486dc1f76bf" status: 200 len: 1367 microversion: 2.1 time: 0.156979 May 30 12:08:24.553028 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 295/579] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:08:24 2022] GET /compute/v2.1/servers/ed036712-bf1c-4eaa-9736-b486dc1f76bf => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:24.657566 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-04036781-719d-40d2-8913-d59d4523a8aa tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:24.658142 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-04036781-719d-40d2-8913-d59d4523a8aa tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:24.660347 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:08:24.665821 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-04036781-719d-40d2-8913-d59d4523a8aa tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:24.666284 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-04036781-719d-40d2-8913-d59d4523a8aa tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:24.667030 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-04036781-719d-40d2-8913-d59d4523a8aa tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:24.667456 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-04036781-719d-40d2-8913-d59d4523a8aa tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:24.697726 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-04036781-719d-40d2-8913-d59d4523a8aa tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c/os-volume_attachments/10a317d3-33ef-4efa-bb3b-11b734894339" status: 200 len: 194 microversion: 2.20 time: 0.044659 May 30 12:08:24.698301 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 285/580] 10.222.0.32 () {60 vars in 1453 bytes} [Mon May 30 12:08:24 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c/os-volume_attachments/10a317d3-33ef-4efa-bb3b-11b734894339 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 30 12:08:24.762267 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-55179a76-e4bf-4836-ac4c-90bd7418c555 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:24.762749 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-55179a76-e4bf-4836-ac4c-90bd7418c555 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:24.768852 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-55179a76-e4bf-4836-ac4c-90bd7418c555 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:24.769474 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-55179a76-e4bf-4836-ac4c-90bd7418c555 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:24.770230 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-55179a76-e4bf-4836-ac4c-90bd7418c555 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:24.770654 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-55179a76-e4bf-4836-ac4c-90bd7418c555 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:24.854810 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.objects.instance [None req-55179a76-e4bf-4836-ac4c-90bd7418c555 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lazy-loading 'services' on Instance uuid 314658c0-2ad4-4987-99bc-f8acf2d7e46c {{(pid=117671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 30 12:08:24.938527 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-55179a76-e4bf-4836-ac4c-90bd7418c555 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "DELETE /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c/os-volume_attachments/10a317d3-33ef-4efa-bb3b-11b734894339" status: 202 len: 0 microversion: 2.20 time: 0.180021 May 30 12:08:24.939121 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 296/581] 10.222.0.32 () {60 vars in 1456 bytes} [Mon May 30 12:08:24 2022] DELETE /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c/os-volume_attachments/10a317d3-33ef-4efa-bb3b-11b734894339 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 30 12:08:24.948948 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-ba2b678b-6f1e-4f91-97fe-1d8d4bdbdf41 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:24.949881 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-ba2b678b-6f1e-4f91-97fe-1d8d4bdbdf41 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:24.956433 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ba2b678b-6f1e-4f91-97fe-1d8d4bdbdf41 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:24.956990 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ba2b678b-6f1e-4f91-97fe-1d8d4bdbdf41 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:24.957760 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ba2b678b-6f1e-4f91-97fe-1d8d4bdbdf41 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:24.958551 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ba2b678b-6f1e-4f91-97fe-1d8d4bdbdf41 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:24.987885 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-ba2b678b-6f1e-4f91-97fe-1d8d4bdbdf41 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043400 May 30 12:08:24.988493 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 286/582] 10.222.0.32 () {60 vars in 1342 bytes} [Mon May 30 12:08:24 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 30 12:08:25.163436 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-2bce1996-616f-4f02-a977-447c05938615 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:25.164183 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-2bce1996-616f-4f02-a977-447c05938615 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 83f672fe-d699-4f70-bc26-74dced714a5d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:25.170586 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2bce1996-616f-4f02-a977-447c05938615 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:25.171032 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2bce1996-616f-4f02-a977-447c05938615 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:25.171828 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2bce1996-616f-4f02-a977-447c05938615 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:25.172288 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2bce1996-616f-4f02-a977-447c05938615 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:25.305743 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-2bce1996-616f-4f02-a977-447c05938615 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:25.313761 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-2bce1996-616f-4f02-a977-447c05938615 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d" status: 200 len: 1717 microversion: 2.1 time: 0.155458 May 30 12:08:25.314325 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 297/583] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:08:25 2022] GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d => generated 1717 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:25.422197 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-7fb10729-a2cf-40a3-9096-fc22cf3edc60 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:25.422628 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-7fb10729-a2cf-40a3-9096-fc22cf3edc60 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 83f672fe-d699-4f70-bc26-74dced714a5d] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:25.429530 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7fb10729-a2cf-40a3-9096-fc22cf3edc60 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:25.429978 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7fb10729-a2cf-40a3-9096-fc22cf3edc60 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:25.430748 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7fb10729-a2cf-40a3-9096-fc22cf3edc60 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:25.431552 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7fb10729-a2cf-40a3-9096-fc22cf3edc60 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:25.510760 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.wsgi [None req-7fb10729-a2cf-40a3-9096-fc22cf3edc60 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] HTTP exception thrown: Cannot 'detach_volume' instance 83f672fe-d699-4f70-bc26-74dced714a5d while it is in vm_state rescued May 30 12:08:25.512400 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-7fb10729-a2cf-40a3-9096-fc22cf3edc60 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Request method failure captured: May 30 12:08:25.512400 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: request: DELETE /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d/os-volume_attachments/4ae317b9-5467-4b66-acdd-880a45951304 HTTP/1.1 May 30 12:08:25.512400 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Accept: application/json May 30 12:08:25.512400 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Accept-Encoding: identity May 30 12:08:25.512400 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Connection: close May 30 12:08:25.512400 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Content-Length: 0 May 30 12:08:25.512400 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Content-Type: application/json May 30 12:08:25.512400 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Host: 10.222.0.32 May 30 12:08:25.512400 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Openstack-System-Scope: None May 30 12:08:25.512400 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: User-Agent: python-urllib3/1.26.9 May 30 12:08:25.512400 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Auth-Token: gAAAAABilLLKaQ7R80jiEHRLmMrujboD3ODo5PM_i4LfUigoNF_DSRD-7m3i96fJPk4sXF92TJEZUPTnq8UGqrdvMfAQbAX4zb4JhkZC8_4ziYoLVdZLK1Z5QiAolwIvziAlwa96-4sK6MPzDNEdNjihrFq_GGUSlYxiBpvkGIb3KNss7ddJ3EE May 30 12:08:25.512400 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Domain-Id: None May 30 12:08:25.512400 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Domain-Name: None May 30 12:08:25.512400 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Identity-Status: Confirmed May 30 12:08:25.512400 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Is-Admin-Project: True May 30 12:08:25.512400 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Domain-Id: default May 30 12:08:25.512400 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Domain-Name: Default May 30 12:08:25.512400 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Id: c988db8e79bf4c98ac288105177f90f2 May 30 12:08:25.512400 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1940623031 May 30 12:08:25.512400 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Role: reader,member May 30 12:08:25.512400 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Roles: reader,member May 30 12:08:25.513823 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/c988db8e79bf4c98ac288105177f90f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/c988db8e79bf4c98ac288105177f90f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/c988db8e79bf4c98ac288105177f90f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_c988db8e79bf4c98ac288105177f90f2", "adminURL": "http://10.222.0.32:8080"}]}] May 30 12:08:25.513823 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1940623031 May 30 12:08:25.513823 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant-Id: c988db8e79bf4c98ac288105177f90f2 May 30 12:08:25.513823 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1940623031 May 30 12:08:25.513823 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User: tempest-ServerRescueNegativeTestJSON-1940623031-project May 30 12:08:25.513823 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Domain-Id: default May 30 12:08:25.513823 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Domain-Name: Default May 30 12:08:25.513823 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Id: 166b42a5d6c04659afb20c088dfead76 May 30 12:08:25.513823 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1940623031-project May 30 12:08:25.513823 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: method: > May 30 12:08:25.513823 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: exception: Cannot 'detach_volume' instance 83f672fe-d699-4f70-bc26-74dced714a5d while it is in vm_state rescued May 30 12:08:25.514707 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: action_args: {'server_id': '83f672fe-d699-4f70-bc26-74dced714a5d', 'id': '4ae317b9-5467-4b66-acdd-880a45951304'} May 30 12:08:25.514707 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:08:25.514707 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:08:25.514707 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 30 12:08:25.514707 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 30 12:08:25.514707 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 30 12:08:25.514707 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 30 12:08:25.514707 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 30 12:08:25.514707 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 30 12:08:25.514707 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 83f672fe-d699-4f70-bc26-74dced714a5d in vm_state rescued. Cannot detach_volume while the instance is in this state. May 30 12:08:25.514707 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:08:25.514707 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:08:25.514707 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:08:25.514707 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:08:25.514707 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:08:25.514707 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:08:25.514707 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:08:25.514707 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:08:25.514707 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:08:25.514707 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:08:25.516468 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 30 12:08:25.516468 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 30 12:08:25.516468 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 30 12:08:25.516468 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 30 12:08:25.516468 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 83f672fe-d699-4f70-bc26-74dced714a5d while it is in vm_state rescued May 30 12:08:25.516468 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:08:25.516468 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:08:25.516468 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:08:25.516468 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:08:25.516468 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:08:25.516468 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:08:25.516468 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:08:25.516468 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:08:25.516468 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 83f672fe-d699-4f70-bc26-74dced714a5d while it is in vm_state rescued May 30 12:08:25.516468 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:08:25.516468 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-7fb10729-a2cf-40a3-9096-fc22cf3edc60 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Returning 409 to user: Cannot 'detach_volume' instance 83f672fe-d699-4f70-bc26-74dced714a5d while it is in vm_state rescued {{(pid=117670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:08:25.517824 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-7fb10729-a2cf-40a3-9096-fc22cf3edc60 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "DELETE /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d/os-volume_attachments/4ae317b9-5467-4b66-acdd-880a45951304" status: 409 len: 152 microversion: 2.1 time: 0.095714 May 30 12:08:25.517824 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 287/584] 10.222.0.32 () {58 vars in 1415 bytes} [Mon May 30 12:08:25 2022] DELETE /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d/os-volume_attachments/4ae317b9-5467-4b66-acdd-880a45951304 => generated 152 bytes in 97 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 30 12:08:25.523723 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-5ce00f75-8c01-4296-8b2d-f289871955ae tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:08:25.524285 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-5ce00f75-8c01-4296-8b2d-f289871955ae tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 83f672fe-d699-4f70-bc26-74dced714a5d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:25.530967 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5ce00f75-8c01-4296-8b2d-f289871955ae tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:25.531419 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5ce00f75-8c01-4296-8b2d-f289871955ae tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:25.532211 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5ce00f75-8c01-4296-8b2d-f289871955ae tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:25.532655 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5ce00f75-8c01-4296-8b2d-f289871955ae tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:25.569845 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-02f0eadd-77c8-47f4-9bb0-75a1b3fe49a1 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:25.570489 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-02f0eadd-77c8-47f4-9bb0-75a1b3fe49a1 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: ed036712-bf1c-4eaa-9736-b486dc1f76bf] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:25.576811 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-02f0eadd-77c8-47f4-9bb0-75a1b3fe49a1 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:25.577255 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-02f0eadd-77c8-47f4-9bb0-75a1b3fe49a1 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:25.578018 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-02f0eadd-77c8-47f4-9bb0-75a1b3fe49a1 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:25.578464 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-02f0eadd-77c8-47f4-9bb0-75a1b3fe49a1 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:25.606268 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-5ce00f75-8c01-4296-8b2d-f289871955ae tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "POST /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d/action" status: 202 len: 0 microversion: 2.1 time: 0.087094 May 30 12:08:25.607045 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 298/585] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 30 12:08:25 2022] POST /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 30 12:08:25.616860 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-448b9c27-075e-41ab-b956-94cfb2a85d13 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:25.617742 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-448b9c27-075e-41ab-b956-94cfb2a85d13 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 83f672fe-d699-4f70-bc26-74dced714a5d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:25.624820 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-448b9c27-075e-41ab-b956-94cfb2a85d13 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:25.625276 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-448b9c27-075e-41ab-b956-94cfb2a85d13 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:25.626062 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-448b9c27-075e-41ab-b956-94cfb2a85d13 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:25.626505 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-448b9c27-075e-41ab-b956-94cfb2a85d13 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:25.777247 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-02f0eadd-77c8-47f4-9bb0-75a1b3fe49a1 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7575179edbda45208561c983fc5b956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20763921c37c4e81bba702e09bf628b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:25.792858 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-02f0eadd-77c8-47f4-9bb0-75a1b3fe49a1 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/ed036712-bf1c-4eaa-9736-b486dc1f76bf" status: 200 len: 1367 microversion: 2.1 time: 0.227022 May 30 12:08:25.800521 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 288/586] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:08:25 2022] GET /compute/v2.1/servers/ed036712-bf1c-4eaa-9736-b486dc1f76bf => generated 1367 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:08:25.816891 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-448b9c27-075e-41ab-b956-94cfb2a85d13 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:25.826796 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-448b9c27-075e-41ab-b956-94cfb2a85d13 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d" status: 200 len: 1725 microversion: 2.1 time: 0.214485 May 30 12:08:25.828244 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 299/587] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:08:25 2022] GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d => generated 1725 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:08:26.001447 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-81d02dff-1730-4d21-85f7-0f30eb91c0b5 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:26.002344 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-81d02dff-1730-4d21-85f7-0f30eb91c0b5 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:26.009151 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-81d02dff-1730-4d21-85f7-0f30eb91c0b5 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:26.009600 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-81d02dff-1730-4d21-85f7-0f30eb91c0b5 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:26.010376 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-81d02dff-1730-4d21-85f7-0f30eb91c0b5 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:26.010812 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-81d02dff-1730-4d21-85f7-0f30eb91c0b5 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:26.014427 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell1:SELECT=100 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:08:26.041308 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-81d02dff-1730-4d21-85f7-0f30eb91c0b5 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043961 May 30 12:08:26.041861 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 289/588] 10.222.0.32 () {60 vars in 1342 bytes} [Mon May 30 12:08:25 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 30 12:08:26.810265 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-5ec85284-a46f-42d4-8173-83946ef3da36 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:26.811001 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-5ec85284-a46f-42d4-8173-83946ef3da36 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: ed036712-bf1c-4eaa-9736-b486dc1f76bf] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:26.827233 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5ec85284-a46f-42d4-8173-83946ef3da36 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:26.827681 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5ec85284-a46f-42d4-8173-83946ef3da36 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:26.832369 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5ec85284-a46f-42d4-8173-83946ef3da36 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:26.832815 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5ec85284-a46f-42d4-8173-83946ef3da36 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:26.851195 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-bf32b525-c1ef-41be-a6f6-9e611476e029 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:26.852836 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-bf32b525-c1ef-41be-a6f6-9e611476e029 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 83f672fe-d699-4f70-bc26-74dced714a5d] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:26.862734 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-bf32b525-c1ef-41be-a6f6-9e611476e029 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:26.863195 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-bf32b525-c1ef-41be-a6f6-9e611476e029 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:26.864011 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-bf32b525-c1ef-41be-a6f6-9e611476e029 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:26.864655 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-bf32b525-c1ef-41be-a6f6-9e611476e029 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:27.056399 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-bf32b525-c1ef-41be-a6f6-9e611476e029 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:27.065373 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-bf32b525-c1ef-41be-a6f6-9e611476e029 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d" status: 200 len: 1725 microversion: 2.1 time: 0.222626 May 30 12:08:27.066090 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 290/589] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:08:26 2022] GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d => generated 1725 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:27.076203 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-5ec85284-a46f-42d4-8173-83946ef3da36 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7575179edbda45208561c983fc5b956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20763921c37c4e81bba702e09bf628b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:27.076337 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-7e55795e-f9bc-4cdd-b372-9cc666077f7f tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:27.076337 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-7e55795e-f9bc-4cdd-b372-9cc666077f7f tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:27.078343 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-5ec85284-a46f-42d4-8173-83946ef3da36 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/ed036712-bf1c-4eaa-9736-b486dc1f76bf" status: 200 len: 1557 microversion: 2.1 time: 0.272057 May 30 12:08:27.078953 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 300/590] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:08:26 2022] GET /compute/v2.1/servers/ed036712-bf1c-4eaa-9736-b486dc1f76bf => generated 1557 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:27.079226 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7e55795e-f9bc-4cdd-b372-9cc666077f7f tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:27.079695 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7e55795e-f9bc-4cdd-b372-9cc666077f7f tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:27.080457 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7e55795e-f9bc-4cdd-b372-9cc666077f7f tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:27.080890 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7e55795e-f9bc-4cdd-b372-9cc666077f7f tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:27.096047 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-3acc36d2-73de-49eb-be7e-790ec80eb2e2 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:27.096627 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-3acc36d2-73de-49eb-be7e-790ec80eb2e2 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: ed036712-bf1c-4eaa-9736-b486dc1f76bf] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:27.103528 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3acc36d2-73de-49eb-be7e-790ec80eb2e2 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:27.103971 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3acc36d2-73de-49eb-be7e-790ec80eb2e2 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:27.104868 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3acc36d2-73de-49eb-be7e-790ec80eb2e2 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:27.105299 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3acc36d2-73de-49eb-be7e-790ec80eb2e2 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:27.120525 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-7e55795e-f9bc-4cdd-b372-9cc666077f7f tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052697 May 30 12:08:27.121763 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 291/591] 10.222.0.32 () {60 vars in 1342 bytes} [Mon May 30 12:08:27 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 30 12:08:27.197069 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-3acc36d2-73de-49eb-be7e-790ec80eb2e2 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/ed036712-bf1c-4eaa-9736-b486dc1f76bf/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.104934 May 30 12:08:27.197972 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 301/592] 10.222.0.32 () {58 vars in 1274 bytes} [Mon May 30 12:08:27 2022] GET /compute/v2.1/servers/ed036712-bf1c-4eaa-9736-b486dc1f76bf/os-interface => generated 285 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:08:28.087145 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-316a9750-988d-44ca-877d-e840bafa2610 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:28.087145 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-316a9750-988d-44ca-877d-e840bafa2610 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 83f672fe-d699-4f70-bc26-74dced714a5d] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:28.090707 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-316a9750-988d-44ca-877d-e840bafa2610 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:28.091152 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-316a9750-988d-44ca-877d-e840bafa2610 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:28.091913 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-316a9750-988d-44ca-877d-e840bafa2610 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:28.092398 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-316a9750-988d-44ca-877d-e840bafa2610 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:28.133739 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-dc4257e7-4aca-4a21-bc53-2180467d2db6 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:28.134732 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-dc4257e7-4aca-4a21-bc53-2180467d2db6 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:28.141045 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-dc4257e7-4aca-4a21-bc53-2180467d2db6 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:28.141486 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-dc4257e7-4aca-4a21-bc53-2180467d2db6 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:28.142244 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-dc4257e7-4aca-4a21-bc53-2180467d2db6 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:28.142674 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-dc4257e7-4aca-4a21-bc53-2180467d2db6 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:28.174246 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-dc4257e7-4aca-4a21-bc53-2180467d2db6 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045035 May 30 12:08:28.174771 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 302/593] 10.222.0.32 () {60 vars in 1342 bytes} [Mon May 30 12:08:28 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:08:28.244713 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-16e6faf6-6dfd-49c5-9d32-267f7f4da36f tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:28.245205 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-16e6faf6-6dfd-49c5-9d32-267f7f4da36f tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:28.251157 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-16e6faf6-6dfd-49c5-9d32-267f7f4da36f tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:28.251606 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-16e6faf6-6dfd-49c5-9d32-267f7f4da36f tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:28.252491 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-16e6faf6-6dfd-49c5-9d32-267f7f4da36f tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:28.252994 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-16e6faf6-6dfd-49c5-9d32-267f7f4da36f tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:28.281096 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-16e6faf6-6dfd-49c5-9d32-267f7f4da36f tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Going to try to terminate instance {{(pid=117671) delete /opt/stack/nova/nova/compute/api.py:2664}} May 30 12:08:28.313333 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-316a9750-988d-44ca-877d-e840bafa2610 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:28.324180 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-316a9750-988d-44ca-877d-e840bafa2610 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d" status: 200 len: 1725 microversion: 2.1 time: 0.245100 May 30 12:08:28.325217 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 292/594] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:08:28 2022] GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d => generated 1725 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:28.381846 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-16e6faf6-6dfd-49c5-9d32-267f7f4da36f tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "DELETE /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 204 len: 0 microversion: 2.20 time: 0.140789 May 30 12:08:28.382740 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 303/595] 10.222.0.32 () {60 vars in 1279 bytes} [Mon May 30 12:08:28 2022] DELETE /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 30 12:08:28.390796 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-d43aca2f-f978-42b3-abb3-4e96ac266ad6 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:28.391410 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-d43aca2f-f978-42b3-abb3-4e96ac266ad6 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:28.398583 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d43aca2f-f978-42b3-abb3-4e96ac266ad6 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:28.399035 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d43aca2f-f978-42b3-abb3-4e96ac266ad6 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:28.399806 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d43aca2f-f978-42b3-abb3-4e96ac266ad6 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:28.400273 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d43aca2f-f978-42b3-abb3-4e96ac266ad6 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:28.516654 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-934238fb-21e3-466d-8902-e776156b5143 req-4466acad-d34c-40f8-8b53-97df6137274d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed036712-bf1c-4eaa-9736-b486dc1f76bf", "tag": "4e970db9-1999-42dc-98dc-b12c5dd44b3f"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:08:28.526061 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-934238fb-21e3-466d-8902-e776156b5143 req-4466acad-d34c-40f8-8b53-97df6137274d service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:28.526499 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-934238fb-21e3-466d-8902-e776156b5143 req-4466acad-d34c-40f8-8b53-97df6137274d service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:28.540525 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-934238fb-21e3-466d-8902-e776156b5143 req-4466acad-d34c-40f8-8b53-97df6137274d service nova] Creating event network-changed:4e970db9-1999-42dc-98dc-b12c5dd44b3f for instance ed036712-bf1c-4eaa-9736-b486dc1f76bf on hv-cinder-84051 May 30 12:08:28.545709 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-934238fb-21e3-466d-8902-e776156b5143 req-4466acad-d34c-40f8-8b53-97df6137274d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032940 May 30 12:08:28.546548 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 304/596] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:08:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 30 12:08:28.573538 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-d43aca2f-f978-42b3-abb3-4e96ac266ad6 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:28.582417 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-d43aca2f-f978-42b3-abb3-4e96ac266ad6 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:28.583846 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-d43aca2f-f978-42b3-abb3-4e96ac266ad6 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:28.585079 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-d43aca2f-f978-42b3-abb3-4e96ac266ad6 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1723 microversion: 2.20 time: 0.198146 May 30 12:08:28.585636 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 293/597] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:08:28 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1723 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:08:29.350894 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-a1c9abc4-f79d-494e-915c-0f3996a0ef99 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:29.351591 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-a1c9abc4-f79d-494e-915c-0f3996a0ef99 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 83f672fe-d699-4f70-bc26-74dced714a5d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:29.358912 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a1c9abc4-f79d-494e-915c-0f3996a0ef99 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:29.359665 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a1c9abc4-f79d-494e-915c-0f3996a0ef99 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:29.360605 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a1c9abc4-f79d-494e-915c-0f3996a0ef99 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:29.361041 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a1c9abc4-f79d-494e-915c-0f3996a0ef99 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:29.507646 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-a1c9abc4-f79d-494e-915c-0f3996a0ef99 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:29.515808 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-a1c9abc4-f79d-494e-915c-0f3996a0ef99 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d" status: 200 len: 1725 microversion: 2.1 time: 0.169793 May 30 12:08:29.516430 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 305/598] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:08:29 2022] GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:29.603916 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-a3f2535b-c8d8-417f-bdf1-eb2544475c33 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:29.604504 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-a3f2535b-c8d8-417f-bdf1-eb2544475c33 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:29.611109 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a3f2535b-c8d8-417f-bdf1-eb2544475c33 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:29.611557 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a3f2535b-c8d8-417f-bdf1-eb2544475c33 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:29.612360 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a3f2535b-c8d8-417f-bdf1-eb2544475c33 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:29.612804 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a3f2535b-c8d8-417f-bdf1-eb2544475c33 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:29.745142 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-a3f2535b-c8d8-417f-bdf1-eb2544475c33 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:29.753324 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-a3f2535b-c8d8-417f-bdf1-eb2544475c33 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:29.754837 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-a3f2535b-c8d8-417f-bdf1-eb2544475c33 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:29.756680 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-a3f2535b-c8d8-417f-bdf1-eb2544475c33 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1723 microversion: 2.20 time: 0.157692 May 30 12:08:29.757276 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 294/599] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:08:29 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:08:30.533590 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-7e251e1d-1108-4e23-9f59-06c73257d785 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:30.534207 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-7e251e1d-1108-4e23-9f59-06c73257d785 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 83f672fe-d699-4f70-bc26-74dced714a5d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:30.541780 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7e251e1d-1108-4e23-9f59-06c73257d785 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:30.542218 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7e251e1d-1108-4e23-9f59-06c73257d785 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:30.542972 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7e251e1d-1108-4e23-9f59-06c73257d785 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:30.543401 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7e251e1d-1108-4e23-9f59-06c73257d785 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:30.692483 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-7e251e1d-1108-4e23-9f59-06c73257d785 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:30.701235 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-7e251e1d-1108-4e23-9f59-06c73257d785 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d" status: 200 len: 1731 microversion: 2.1 time: 0.171436 May 30 12:08:30.701818 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 306/600] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:08:30 2022] GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d => generated 1731 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:30.717989 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-812bb22b-4fdb-437c-9ff8-aa9cd47b3049 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:30.718511 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-812bb22b-4fdb-437c-9ff8-aa9cd47b3049 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 83f672fe-d699-4f70-bc26-74dced714a5d] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:30.725604 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-812bb22b-4fdb-437c-9ff8-aa9cd47b3049 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:30.726191 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-812bb22b-4fdb-437c-9ff8-aa9cd47b3049 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:30.726976 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-812bb22b-4fdb-437c-9ff8-aa9cd47b3049 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:30.727420 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-812bb22b-4fdb-437c-9ff8-aa9cd47b3049 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:30.776477 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-9df4dcf0-b35b-4a86-9f37-d528b9556b48 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:30.777096 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-9df4dcf0-b35b-4a86-9f37-d528b9556b48 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:30.783631 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9df4dcf0-b35b-4a86-9f37-d528b9556b48 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:30.785047 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9df4dcf0-b35b-4a86-9f37-d528b9556b48 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:30.785828 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9df4dcf0-b35b-4a86-9f37-d528b9556b48 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:30.786266 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9df4dcf0-b35b-4a86-9f37-d528b9556b48 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:30.793224 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:08:30.817225 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-812bb22b-4fdb-437c-9ff8-aa9cd47b3049 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.103153 May 30 12:08:30.817942 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 295/601] 10.222.0.32 () {58 vars in 1274 bytes} [Mon May 30 12:08:30 2022] GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:08:31.041065 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-9df4dcf0-b35b-4a86-9f37-d528b9556b48 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:31.050563 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-9df4dcf0-b35b-4a86-9f37-d528b9556b48 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:31.052378 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-9df4dcf0-b35b-4a86-9f37-d528b9556b48 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:31.053964 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-9df4dcf0-b35b-4a86-9f37-d528b9556b48 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1723 microversion: 2.20 time: 0.282550 May 30 12:08:31.054801 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 307/602] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:08:30 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1723 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 30 12:08:31.897898 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-2e6637be-3f9d-4665-adb7-da55a7f49cfc req-d93878c5-986b-49e5-b245-1a84b7a99b46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83f672fe-d699-4f70-bc26-74dced714a5d", "tag": "e405a0d8-23b0-474a-be51-1a5734d329c4"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:08:31.906114 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-2e6637be-3f9d-4665-adb7-da55a7f49cfc req-d93878c5-986b-49e5-b245-1a84b7a99b46 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:31.906820 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-2e6637be-3f9d-4665-adb7-da55a7f49cfc req-d93878c5-986b-49e5-b245-1a84b7a99b46 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:31.919079 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-2e6637be-3f9d-4665-adb7-da55a7f49cfc req-d93878c5-986b-49e5-b245-1a84b7a99b46 service nova] Creating event network-changed:e405a0d8-23b0-474a-be51-1a5734d329c4 for instance 83f672fe-d699-4f70-bc26-74dced714a5d on hv-cinder-84051 May 30 12:08:31.925032 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-2e6637be-3f9d-4665-adb7-da55a7f49cfc req-d93878c5-986b-49e5-b245-1a84b7a99b46 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031570 May 30 12:08:31.926396 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 296/603] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:08:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:08:32.073440 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-d6bfd6ad-dd67-4da6-a0d4-a6e489c20213 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:32.074121 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-d6bfd6ad-dd67-4da6-a0d4-a6e489c20213 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:32.081384 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d6bfd6ad-dd67-4da6-a0d4-a6e489c20213 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:32.082243 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d6bfd6ad-dd67-4da6-a0d4-a6e489c20213 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:32.083107 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d6bfd6ad-dd67-4da6-a0d4-a6e489c20213 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:32.083682 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d6bfd6ad-dd67-4da6-a0d4-a6e489c20213 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:32.154893 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-d6bfd6ad-dd67-4da6-a0d4-a6e489c20213 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:32.164748 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-d6bfd6ad-dd67-4da6-a0d4-a6e489c20213 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:32.166253 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-d6bfd6ad-dd67-4da6-a0d4-a6e489c20213 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:32.167620 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-d6bfd6ad-dd67-4da6-a0d4-a6e489c20213 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 200 len: 1655 microversion: 2.20 time: 0.098729 May 30 12:08:32.168678 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 308/604] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:08:32 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 1655 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:08:32.291446 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-ad8cff19-8da3-4ea5-9f68-cbfe1ed0246f req-57e191a9-94a2-4d19-919d-3e5ee377f09d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "314658c0-2ad4-4987-99bc-f8acf2d7e46c", "name": "network-vif-deleted", "tag": "66de87a6-f3b1-41fb-8926-85240efcbe51"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:08:32.323029 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-ad8cff19-8da3-4ea5-9f68-cbfe1ed0246f req-57e191a9-94a2-4d19-919d-3e5ee377f09d service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:32.324867 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-ad8cff19-8da3-4ea5-9f68-cbfe1ed0246f req-57e191a9-94a2-4d19-919d-3e5ee377f09d service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:32.343417 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-ad8cff19-8da3-4ea5-9f68-cbfe1ed0246f req-57e191a9-94a2-4d19-919d-3e5ee377f09d service nova] Creating event network-vif-deleted:66de87a6-f3b1-41fb-8926-85240efcbe51 for instance 314658c0-2ad4-4987-99bc-f8acf2d7e46c on hv-cinder-84051 May 30 12:08:32.361107 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-ad8cff19-8da3-4ea5-9f68-cbfe1ed0246f req-57e191a9-94a2-4d19-919d-3e5ee377f09d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076317 May 30 12:08:32.365593 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 297/605] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:08:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:08:33.188384 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-5d508c6f-5751-4e80-bf27-c535bd412be7 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:33.193843 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-5d508c6f-5751-4e80-bf27-c535bd412be7 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:33.201505 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5d508c6f-5751-4e80-bf27-c535bd412be7 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:33.202260 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5d508c6f-5751-4e80-bf27-c535bd412be7 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:33.203405 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5d508c6f-5751-4e80-bf27-c535bd412be7 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:33.204078 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5d508c6f-5751-4e80-bf27-c535bd412be7 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:33.225251 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.wsgi [None req-5d508c6f-5751-4e80-bf27-c535bd412be7 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] HTTP exception thrown: Instance 314658c0-2ad4-4987-99bc-f8acf2d7e46c could not be found. May 30 12:08:33.227076 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-5d508c6f-5751-4e80-bf27-c535bd412be7 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Request method failure captured: May 30 12:08:33.227076 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: request: GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c HTTP/1.1 May 30 12:08:33.227076 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Accept: application/json May 30 12:08:33.227076 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Accept-Encoding: identity May 30 12:08:33.227076 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Connection: close May 30 12:08:33.227076 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Content-Length: 0 May 30 12:08:33.227076 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Content-Type: application/json May 30 12:08:33.227076 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Host: 10.222.0.32 May 30 12:08:33.227076 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Openstack-System-Scope: None May 30 12:08:33.227076 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: User-Agent: python-urllib3/1.26.9 May 30 12:08:33.227076 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Auth-Token: gAAAAABilLLI-jg3RotS7Wk43mDzzFxx0AOTox6SrMZQ2W86czASNqXFuxoVYDnJMcYhwpMGTnKCYVCopKaoURue3PP-yB4J0da2kvIVZIQxiR99ndktD6fHm8BTWt1aSZpv_MEGTOOpGL9UUj82swUqJ6QblDAt3ZJcoqLk6V0-Rlt3YtmTVQw May 30 12:08:33.227076 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Domain-Id: None May 30 12:08:33.227076 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Domain-Name: None May 30 12:08:33.227076 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Identity-Status: Confirmed May 30 12:08:33.227076 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Is-Admin-Project: True May 30 12:08:33.227076 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Openstack-Nova-Api-Version: 2.20 May 30 12:08:33.227076 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Domain-Id: default May 30 12:08:33.227076 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Domain-Name: Default May 30 12:08:33.227076 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Id: 8e98cc41e8064c90b0e45b32e2d78493 May 30 12:08:33.227076 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-704534015 May 30 12:08:33.227076 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Role: reader,member May 30 12:08:33.227076 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Roles: reader,member May 30 12:08:33.228847 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/8e98cc41e8064c90b0e45b32e2d78493"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/8e98cc41e8064c90b0e45b32e2d78493"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/8e98cc41e8064c90b0e45b32e2d78493"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_8e98cc41e8064c90b0e45b32e2d78493", "adminURL": "http://10.222.0.32:8080"}]}] May 30 12:08:33.228847 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Tenant: tempest-AttachVolumeShelveTestJSON-704534015 May 30 12:08:33.228847 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Tenant-Id: 8e98cc41e8064c90b0e45b32e2d78493 May 30 12:08:33.228847 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-704534015 May 30 12:08:33.228847 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User: tempest-AttachVolumeShelveTestJSON-704534015-project May 30 12:08:33.228847 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Domain-Id: default May 30 12:08:33.228847 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Domain-Name: Default May 30 12:08:33.228847 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Id: bc47c5bf77894aefa6ecde115ed9f88f May 30 12:08:33.228847 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Name: tempest-AttachVolumeShelveTestJSON-704534015-project May 30 12:08:33.228847 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: method: > May 30 12:08:33.228847 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: exception: Instance 314658c0-2ad4-4987-99bc-f8acf2d7e46c could not be found. May 30 12:08:33.228847 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: action_args: {'id': '314658c0-2ad4-4987-99bc-f8acf2d7e46c'} May 30 12:08:33.229750 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:08:33.229750 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:08:33.229750 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:08:33.229750 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:08:33.229750 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:08:33.229750 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:08:33.229750 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:08:33.229750 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:08:33.229750 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:08:33.229750 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:08:33.229750 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 314658c0-2ad4-4987-99bc-f8acf2d7e46c could not be found. May 30 12:08:33.229750 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:08:33.229750 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:08:33.229750 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:08:33.229750 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:08:33.229750 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:08:33.229750 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:08:33.229750 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:08:33.229750 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:08:33.229750 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:08:33.231249 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:08:33.231249 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 30 12:08:33.231249 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 30 12:08:33.231249 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 30 12:08:33.231249 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 30 12:08:33.231249 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:08:33.231249 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:08:33.231249 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 314658c0-2ad4-4987-99bc-f8acf2d7e46c could not be found. May 30 12:08:33.231249 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:08:33.231249 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:08:33.231249 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:08:33.231249 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:08:33.231249 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:08:33.231249 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:08:33.231249 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:08:33.231249 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:08:33.231249 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 314658c0-2ad4-4987-99bc-f8acf2d7e46c could not be found. May 30 12:08:33.231249 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:08:33.232570 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-5d508c6f-5751-4e80-bf27-c535bd412be7 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Returning 404 to user: Instance 314658c0-2ad4-4987-99bc-f8acf2d7e46c could not be found. {{(pid=117671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:08:33.232570 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-5d508c6f-5751-4e80-bf27-c535bd412be7 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 404 len: 111 microversion: 2.20 time: 0.046620 May 30 12:08:33.235877 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 309/606] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:08:33 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 30 12:08:33.242052 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-4c76cd18-7232-4b76-9bc1-cf2eef7e4af6 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '.version_select at 0x7f0efac43280>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:33.263499 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-4c76cd18-7232-4b76-9bc1-cf2eef7e4af6 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2112876361" status: 204 len: 0 microversion: 2.20 time: 0.026402 May 30 12:08:33.264088 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 298/607] 10.222.0.32 () {60 vars in 1261 bytes} [Mon May 30 12:08:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2112876361 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 30 12:08:33.943769 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-cee6f31c-8e71-43aa-9298-cce92e8e49b3 req-6dc07e63-b40b-4baf-922b-3b88c98d88e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83f672fe-d699-4f70-bc26-74dced714a5d", "tag": "e405a0d8-23b0-474a-be51-1a5734d329c4"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:08:33.951953 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-cee6f31c-8e71-43aa-9298-cce92e8e49b3 req-6dc07e63-b40b-4baf-922b-3b88c98d88e6 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:33.952424 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-cee6f31c-8e71-43aa-9298-cce92e8e49b3 req-6dc07e63-b40b-4baf-922b-3b88c98d88e6 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:33.967036 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-cee6f31c-8e71-43aa-9298-cce92e8e49b3 req-6dc07e63-b40b-4baf-922b-3b88c98d88e6 service nova] Creating event network-changed:e405a0d8-23b0-474a-be51-1a5734d329c4 for instance 83f672fe-d699-4f70-bc26-74dced714a5d on hv-cinder-84051 May 30 12:08:33.974349 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-cee6f31c-8e71-43aa-9298-cce92e8e49b3 req-6dc07e63-b40b-4baf-922b-3b88c98d88e6 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035928 May 30 12:08:33.975138 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 310/608] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:08:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:08:33.994718 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-d0a7a381-f9c9-4754-93a6-8ed6bc17a359 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Action: 'create', calling method: .version_select at 0x7f0ef87e5280>, body: {"keypair": {"name": "tempest-keypair-489913905", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPAHdYLuUP0867XiZI33AIXk1QLN2Jie1maZdYzpXQR42BCZiO/+rlfq4yV8jeNJ2YltXCOEpnzlxxTKkymP08oiR5nl6mhPlK6+ZEQMOIjb/F9ZL8p7zVojuyXanot1ZA=="}} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:08:34.009767 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.quota [None req-d0a7a381-f9c9-4754-93a6-8ed6bc17a359 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Getting quotas for project 8e98cc41e8064c90b0e45b32e2d78493. Resources: {'key_pairs'} {{(pid=117670) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 30 12:08:34.013805 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.quota [None req-d0a7a381-f9c9-4754-93a6-8ed6bc17a359 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Getting quotas for user bc47c5bf77894aefa6ecde115ed9f88f and project 8e98cc41e8064c90b0e45b32e2d78493. Resources: {'key_pairs'} {{(pid=117670) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 30 12:08:34.039813 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-d0a7a381-f9c9-4754-93a6-8ed6bc17a359 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.049915 May 30 12:08:34.040660 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 299/609] 10.222.0.32 () {62 vars in 1199 bytes} [Mon May 30 12:08:33 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 51 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 30 12:08:35.824421 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-d0ac21c1-ee08-4ebb-a5fb-14551c395246 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1314109347", "imageRef": "b8ef93ed-af98-4d8c-9e1d-43d7b1f2b832", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1b1749ee-1593-44ab-bdce-c8c4ff3a2f62"}], "security_groups": [{"name": "tempest-securitygroup--855214793"}], "key_name": "tempest-keypair-489913905", "user_data": "}} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:08:35.931352 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.network.neutron [None req-d0ac21c1-ee08-4ebb-a5fb-14551c395246 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] validate_networks() for [('1b1749ee-1593-44ab-bdce-c8c4ff3a2f62', None, None, None, None, None)] {{(pid=117671) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 30 12:08:36.307780 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-d0ac21c1-ee08-4ebb-a5fb-14551c395246 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Flavor limits 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 30 12:08:36.308232 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-d0ac21c1-ee08-4ebb-a5fb-14551c395246 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Image limits 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 30 12:08:36.308703 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-d0ac21c1-ee08-4ebb-a5fb-14551c395246 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Flavor pref 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 30 12:08:36.309135 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-d0ac21c1-ee08-4ebb-a5fb-14551c395246 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Image pref 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 30 12:08:36.309544 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-d0ac21c1-ee08-4ebb-a5fb-14551c395246 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 30 12:08:36.318900 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d0ac21c1-ee08-4ebb-a5fb-14551c395246 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:36.319370 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d0ac21c1-ee08-4ebb-a5fb-14551c395246 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:36.320184 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d0ac21c1-ee08-4ebb-a5fb-14551c395246 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:36.320636 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d0ac21c1-ee08-4ebb-a5fb-14551c395246 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:36.341981 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.quota [None req-d0ac21c1-ee08-4ebb-a5fb-14551c395246 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Getting quotas for project 8e98cc41e8064c90b0e45b32e2d78493. Resources: {'cores', 'instances', 'ram'} {{(pid=117671) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 30 12:08:36.345938 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.quota [None req-d0ac21c1-ee08-4ebb-a5fb-14551c395246 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Getting quotas for user bc47c5bf77894aefa6ecde115ed9f88f and project 8e98cc41e8064c90b0e45b32e2d78493. Resources: {'cores', 'instances', 'ram'} {{(pid=117671) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 30 12:08:36.359338 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-d0ac21c1-ee08-4ebb-a5fb-14551c395246 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Going to run 1 instances... {{(pid=117671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 30 12:08:36.362285 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-d0ac21c1-ee08-4ebb-a5fb-14551c395246 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b8ef93ed-af98-4d8c-9e1d-43d7b1f2b832',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 30 12:08:36.414588 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-d0ac21c1-ee08-4ebb-a5fb-14551c395246 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.595181 May 30 12:08:36.415627 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 311/610] 10.222.0.32 () {62 vars in 1187 bytes} [Mon May 30 12:08:35 2022] POST /compute/v2.1/servers => generated 401 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 30 12:08:36.429244 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-f75b0f94-6d67-4a2a-baaa-0a54cc27e025 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:36.430671 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-f75b0f94-6d67-4a2a-baaa-0a54cc27e025 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:36.500309 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-f75b0f94-6d67-4a2a-baaa-0a54cc27e025 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:36.509644 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-f75b0f94-6d67-4a2a-baaa-0a54cc27e025 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:36.511152 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-f75b0f94-6d67-4a2a-baaa-0a54cc27e025 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:36.512308 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-f75b0f94-6d67-4a2a-baaa-0a54cc27e025 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c" status: 200 len: 1281 microversion: 2.20 time: 0.089844 May 30 12:08:36.512880 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 300/611] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:08:36 2022] GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c => generated 1281 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:08:37.531623 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-252f8f95-ce29-4266-b944-a8c7c723199b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:37.532287 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-252f8f95-ce29-4266-b944-a8c7c723199b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:37.538836 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-252f8f95-ce29-4266-b944-a8c7c723199b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:37.539286 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-252f8f95-ce29-4266-b944-a8c7c723199b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:37.540064 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-252f8f95-ce29-4266-b944-a8c7c723199b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:37.540527 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-252f8f95-ce29-4266-b944-a8c7c723199b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:37.605512 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-252f8f95-ce29-4266-b944-a8c7c723199b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:37.615484 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-252f8f95-ce29-4266-b944-a8c7c723199b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:37.617056 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-252f8f95-ce29-4266-b944-a8c7c723199b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:37.618172 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-252f8f95-ce29-4266-b944-a8c7c723199b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c" status: 200 len: 1285 microversion: 2.20 time: 0.091309 May 30 12:08:37.618732 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 312/612] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:08:37 2022] GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c => generated 1285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:08:38.636606 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-e3f4879d-5739-4c10-bd31-dc567df031c2 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:38.637214 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-e3f4879d-5739-4c10-bd31-dc567df031c2 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:38.639578 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-23297068-0f7c-4370-8c80-feba78b41f2b tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:38.640590 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-23297068-0f7c-4370-8c80-feba78b41f2b tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 08b1b860-516e-4041-8df8-1fa8cc65a4ed] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:38.644289 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e3f4879d-5739-4c10-bd31-dc567df031c2 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:38.644733 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e3f4879d-5739-4c10-bd31-dc567df031c2 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:38.645682 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e3f4879d-5739-4c10-bd31-dc567df031c2 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:38.647067 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e3f4879d-5739-4c10-bd31-dc567df031c2 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:38.647988 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-23297068-0f7c-4370-8c80-feba78b41f2b tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:38.648468 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-23297068-0f7c-4370-8c80-feba78b41f2b tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:38.649252 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-23297068-0f7c-4370-8c80-feba78b41f2b tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:38.649685 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-23297068-0f7c-4370-8c80-feba78b41f2b tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:38.679848 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-23297068-0f7c-4370-8c80-feba78b41f2b tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044035 May 30 12:08:38.680462 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 313/613] 10.222.0.32 () {58 vars in 1301 bytes} [Mon May 30 12:08:38 2022] GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 30 12:08:38.713840 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-e3f4879d-5739-4c10-bd31-dc567df031c2 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:38.721837 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-e3f4879d-5739-4c10-bd31-dc567df031c2 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:38.723355 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-e3f4879d-5739-4c10-bd31-dc567df031c2 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:38.724581 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-e3f4879d-5739-4c10-bd31-dc567df031c2 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c" status: 200 len: 1277 microversion: 2.20 time: 0.091938 May 30 12:08:38.725137 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 301/614] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:08:38 2022] GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c => generated 1277 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:08:38.742824 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-549a30b7-3335-40cb-8f91-673f9bd971ee tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:38.743353 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-549a30b7-3335-40cb-8f91-673f9bd971ee tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 08b1b860-516e-4041-8df8-1fa8cc65a4ed] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:38.749690 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-549a30b7-3335-40cb-8f91-673f9bd971ee tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:38.750161 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-549a30b7-3335-40cb-8f91-673f9bd971ee tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:38.750907 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-549a30b7-3335-40cb-8f91-673f9bd971ee tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:38.751347 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-549a30b7-3335-40cb-8f91-673f9bd971ee tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:38.777150 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-549a30b7-3335-40cb-8f91-673f9bd971ee tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 08b1b860-516e-4041-8df8-1fa8cc65a4ed] Going to try to terminate instance {{(pid=117671) delete /opt/stack/nova/nova/compute/api.py:2664}} May 30 12:08:38.853998 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-549a30b7-3335-40cb-8f91-673f9bd971ee tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "DELETE /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed" status: 204 len: 0 microversion: 2.1 time: 0.114778 May 30 12:08:38.854604 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 314/615] 10.222.0.32 () {58 vars in 1238 bytes} [Mon May 30 12:08:38 2022] DELETE /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 30 12:08:38.863438 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-b9f39dd4-7a64-4082-8d90-dcd851d65aa1 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:38.864131 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-b9f39dd4-7a64-4082-8d90-dcd851d65aa1 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 08b1b860-516e-4041-8df8-1fa8cc65a4ed] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:38.870256 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b9f39dd4-7a64-4082-8d90-dcd851d65aa1 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:38.870705 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b9f39dd4-7a64-4082-8d90-dcd851d65aa1 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:38.871476 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b9f39dd4-7a64-4082-8d90-dcd851d65aa1 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:38.872174 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b9f39dd4-7a64-4082-8d90-dcd851d65aa1 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:39.003090 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-b9f39dd4-7a64-4082-8d90-dcd851d65aa1 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76e8d7bfdc04ea79c83ca7fb6b9ade1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5074cf3e6248668995f266845c8969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:39.011536 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-b9f39dd4-7a64-4082-8d90-dcd851d65aa1 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed" status: 200 len: 1673 microversion: 2.1 time: 0.152291 May 30 12:08:39.012105 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 302/616] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:08:38 2022] GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed => generated 1673 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:39.744132 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-538a49ef-1cb4-4aaf-b312-dea3992ed066 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:39.744878 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-538a49ef-1cb4-4aaf-b312-dea3992ed066 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:39.751558 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-538a49ef-1cb4-4aaf-b312-dea3992ed066 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:39.752006 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-538a49ef-1cb4-4aaf-b312-dea3992ed066 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:39.752869 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-538a49ef-1cb4-4aaf-b312-dea3992ed066 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:39.753301 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-538a49ef-1cb4-4aaf-b312-dea3992ed066 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:39.815803 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-538a49ef-1cb4-4aaf-b312-dea3992ed066 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:39.824738 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-538a49ef-1cb4-4aaf-b312-dea3992ed066 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:39.826171 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-538a49ef-1cb4-4aaf-b312-dea3992ed066 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:39.827272 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-538a49ef-1cb4-4aaf-b312-dea3992ed066 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c" status: 200 len: 1277 microversion: 2.20 time: 0.088426 May 30 12:08:39.827827 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 315/617] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:08:39 2022] GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c => generated 1277 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:08:40.029399 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-9e39acdb-cf84-4a5d-812b-0e31c7500c65 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:40.030016 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-9e39acdb-cf84-4a5d-812b-0e31c7500c65 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 08b1b860-516e-4041-8df8-1fa8cc65a4ed] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:40.036545 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9e39acdb-cf84-4a5d-812b-0e31c7500c65 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:40.036994 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9e39acdb-cf84-4a5d-812b-0e31c7500c65 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:40.037763 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9e39acdb-cf84-4a5d-812b-0e31c7500c65 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:40.038199 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9e39acdb-cf84-4a5d-812b-0e31c7500c65 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:40.179750 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-9e39acdb-cf84-4a5d-812b-0e31c7500c65 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76e8d7bfdc04ea79c83ca7fb6b9ade1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5074cf3e6248668995f266845c8969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:40.188402 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-9e39acdb-cf84-4a5d-812b-0e31c7500c65 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed" status: 200 len: 1673 microversion: 2.1 time: 0.162837 May 30 12:08:40.188965 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 303/618] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:08:40 2022] GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed => generated 1673 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:40.845439 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-6a2251d8-de73-434f-bfeb-5e2db536d587 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:40.846067 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-6a2251d8-de73-434f-bfeb-5e2db536d587 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:40.853194 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-6a2251d8-de73-434f-bfeb-5e2db536d587 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:40.853634 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-6a2251d8-de73-434f-bfeb-5e2db536d587 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:40.854393 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-6a2251d8-de73-434f-bfeb-5e2db536d587 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:40.854821 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-6a2251d8-de73-434f-bfeb-5e2db536d587 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:40.916508 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-6a2251d8-de73-434f-bfeb-5e2db536d587 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:40.924565 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-6a2251d8-de73-434f-bfeb-5e2db536d587 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:40.926124 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-6a2251d8-de73-434f-bfeb-5e2db536d587 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:40.927377 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-6a2251d8-de73-434f-bfeb-5e2db536d587 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c" status: 200 len: 1277 microversion: 2.20 time: 0.085759 May 30 12:08:40.928242 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 316/619] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:08:40 2022] GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c => generated 1277 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:08:41.205873 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-3a4bef10-497b-44fa-9fc6-06c4c6c18660 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:41.206422 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-3a4bef10-497b-44fa-9fc6-06c4c6c18660 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 08b1b860-516e-4041-8df8-1fa8cc65a4ed] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:41.213579 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3a4bef10-497b-44fa-9fc6-06c4c6c18660 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:41.214036 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3a4bef10-497b-44fa-9fc6-06c4c6c18660 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:41.214790 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3a4bef10-497b-44fa-9fc6-06c4c6c18660 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:41.215225 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3a4bef10-497b-44fa-9fc6-06c4c6c18660 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:41.346750 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-3a4bef10-497b-44fa-9fc6-06c4c6c18660 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76e8d7bfdc04ea79c83ca7fb6b9ade1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5074cf3e6248668995f266845c8969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:41.354586 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-3a4bef10-497b-44fa-9fc6-06c4c6c18660 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed" status: 200 len: 1673 microversion: 2.1 time: 0.152580 May 30 12:08:41.355157 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 304/620] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:08:41 2022] GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed => generated 1673 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:41.945660 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-cb2a379a-4e39-4f6f-a920-2d80fd7f639d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:41.946205 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-cb2a379a-4e39-4f6f-a920-2d80fd7f639d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:41.952857 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-cb2a379a-4e39-4f6f-a920-2d80fd7f639d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:41.953317 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-cb2a379a-4e39-4f6f-a920-2d80fd7f639d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:41.954086 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-cb2a379a-4e39-4f6f-a920-2d80fd7f639d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:41.954522 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-cb2a379a-4e39-4f6f-a920-2d80fd7f639d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:42.018650 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-cb2a379a-4e39-4f6f-a920-2d80fd7f639d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:42.027320 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-cb2a379a-4e39-4f6f-a920-2d80fd7f639d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:42.028857 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-cb2a379a-4e39-4f6f-a920-2d80fd7f639d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:42.029955 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-cb2a379a-4e39-4f6f-a920-2d80fd7f639d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c" status: 200 len: 1277 microversion: 2.20 time: 0.088522 May 30 12:08:42.030512 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 317/621] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:08:41 2022] GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c => generated 1277 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:08:42.373380 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-48ebc03b-bbea-42c2-b423-d9556a7937dd tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:42.373993 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-48ebc03b-bbea-42c2-b423-d9556a7937dd tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 08b1b860-516e-4041-8df8-1fa8cc65a4ed] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:42.381103 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-48ebc03b-bbea-42c2-b423-d9556a7937dd tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:42.381560 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-48ebc03b-bbea-42c2-b423-d9556a7937dd tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:42.382328 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-48ebc03b-bbea-42c2-b423-d9556a7937dd tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:42.382769 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-48ebc03b-bbea-42c2-b423-d9556a7937dd tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:42.519365 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-48ebc03b-bbea-42c2-b423-d9556a7937dd tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76e8d7bfdc04ea79c83ca7fb6b9ade1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5074cf3e6248668995f266845c8969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:42.527816 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-48ebc03b-bbea-42c2-b423-d9556a7937dd tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed" status: 200 len: 1673 microversion: 2.1 time: 0.158328 May 30 12:08:42.528413 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 305/622] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:08:42 2022] GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed => generated 1673 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:43.048284 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-8ec726f2-6ae0-4fb7-837a-d49f344c803b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:43.048888 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-8ec726f2-6ae0-4fb7-837a-d49f344c803b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:43.056111 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8ec726f2-6ae0-4fb7-837a-d49f344c803b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:43.056576 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8ec726f2-6ae0-4fb7-837a-d49f344c803b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:43.057343 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8ec726f2-6ae0-4fb7-837a-d49f344c803b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:43.057765 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8ec726f2-6ae0-4fb7-837a-d49f344c803b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:43.122265 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-8ec726f2-6ae0-4fb7-837a-d49f344c803b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:43.131134 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-8ec726f2-6ae0-4fb7-837a-d49f344c803b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:43.135650 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-8ec726f2-6ae0-4fb7-837a-d49f344c803b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:43.135650 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-8ec726f2-6ae0-4fb7-837a-d49f344c803b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c" status: 200 len: 1333 microversion: 2.20 time: 0.089473 May 30 12:08:43.135650 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 318/623] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:08:43 2022] GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c => generated 1333 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:08:43.545222 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-73a38453-7d7e-43f8-a235-4614df011a28 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:43.546022 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-73a38453-7d7e-43f8-a235-4614df011a28 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 08b1b860-516e-4041-8df8-1fa8cc65a4ed] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:43.553463 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-73a38453-7d7e-43f8-a235-4614df011a28 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:43.553926 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-73a38453-7d7e-43f8-a235-4614df011a28 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:43.555012 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-73a38453-7d7e-43f8-a235-4614df011a28 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:43.555461 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-73a38453-7d7e-43f8-a235-4614df011a28 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:43.697211 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-73a38453-7d7e-43f8-a235-4614df011a28 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76e8d7bfdc04ea79c83ca7fb6b9ade1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5074cf3e6248668995f266845c8969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:43.704825 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-73a38453-7d7e-43f8-a235-4614df011a28 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed" status: 200 len: 1673 microversion: 2.1 time: 0.163534 May 30 12:08:43.705401 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 306/624] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:08:43 2022] GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed => generated 1673 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:44.154000 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-5d241d2e-feb6-4575-a819-7492beebe731 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:44.154581 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-5d241d2e-feb6-4575-a819-7492beebe731 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:44.159122 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:08:44.163862 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5d241d2e-feb6-4575-a819-7492beebe731 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:44.164347 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5d241d2e-feb6-4575-a819-7492beebe731 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:44.165137 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5d241d2e-feb6-4575-a819-7492beebe731 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:44.165579 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5d241d2e-feb6-4575-a819-7492beebe731 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:44.242958 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-5d241d2e-feb6-4575-a819-7492beebe731 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:44.253147 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-5d241d2e-feb6-4575-a819-7492beebe731 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:44.256127 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-5d241d2e-feb6-4575-a819-7492beebe731 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:44.257701 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-5d241d2e-feb6-4575-a819-7492beebe731 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c" status: 200 len: 1339 microversion: 2.20 time: 0.108672 May 30 12:08:44.258455 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 319/625] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:08:44 2022] GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c => generated 1339 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:08:44.724256 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-b8ab61b9-398e-47c3-8645-427f73648051 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:44.725544 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-b8ab61b9-398e-47c3-8645-427f73648051 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 08b1b860-516e-4041-8df8-1fa8cc65a4ed] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:44.735654 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b8ab61b9-398e-47c3-8645-427f73648051 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:44.736204 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b8ab61b9-398e-47c3-8645-427f73648051 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:44.737098 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b8ab61b9-398e-47c3-8645-427f73648051 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:44.737617 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b8ab61b9-398e-47c3-8645-427f73648051 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:44.803631 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-b8ab61b9-398e-47c3-8645-427f73648051 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76e8d7bfdc04ea79c83ca7fb6b9ade1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5074cf3e6248668995f266845c8969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:44.813468 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-b8ab61b9-398e-47c3-8645-427f73648051 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed" status: 200 len: 1606 microversion: 2.1 time: 0.094544 May 30 12:08:44.815118 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 307/626] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:08:44 2022] GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed => generated 1606 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:44.989157 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-af6d61b7-0fed-45f5-ae2f-59d7252cee6b req-f761736d-3be3-4d7b-b10e-3a4836f216b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08b1b860-516e-4041-8df8-1fa8cc65a4ed", "name": "network-vif-deleted", "tag": "2d71add9-9fe3-4c66-b490-513b1ce61d40"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:08:44.997229 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-af6d61b7-0fed-45f5-ae2f-59d7252cee6b req-f761736d-3be3-4d7b-b10e-3a4836f216b8 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:44.997669 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-af6d61b7-0fed-45f5-ae2f-59d7252cee6b req-f761736d-3be3-4d7b-b10e-3a4836f216b8 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:45.009069 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-af6d61b7-0fed-45f5-ae2f-59d7252cee6b req-f761736d-3be3-4d7b-b10e-3a4836f216b8 service nova] Creating event network-vif-deleted:2d71add9-9fe3-4c66-b490-513b1ce61d40 for instance 08b1b860-516e-4041-8df8-1fa8cc65a4ed on hv-cinder-84051 May 30 12:08:45.013870 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-af6d61b7-0fed-45f5-ae2f-59d7252cee6b req-f761736d-3be3-4d7b-b10e-3a4836f216b8 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028317 May 30 12:08:45.014449 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 320/627] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:08:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:08:45.277189 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-25bb0761-0c08-49dc-9e12-7087c56a76ba tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:45.277808 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-25bb0761-0c08-49dc-9e12-7087c56a76ba tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:45.283773 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-25bb0761-0c08-49dc-9e12-7087c56a76ba tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:45.284249 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-25bb0761-0c08-49dc-9e12-7087c56a76ba tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:45.285025 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-25bb0761-0c08-49dc-9e12-7087c56a76ba tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:45.285466 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-25bb0761-0c08-49dc-9e12-7087c56a76ba tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:45.423258 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-25bb0761-0c08-49dc-9e12-7087c56a76ba tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:45.432832 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-25bb0761-0c08-49dc-9e12-7087c56a76ba tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:45.434315 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-25bb0761-0c08-49dc-9e12-7087c56a76ba tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:45.435435 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-25bb0761-0c08-49dc-9e12-7087c56a76ba tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c" status: 200 len: 1406 microversion: 2.20 time: 0.162265 May 30 12:08:45.435997 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 308/628] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:08:45 2022] GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:08:45.832270 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-b30a0c30-c6b2-4c78-9b06-3498538e77ed tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:45.832969 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-b30a0c30-c6b2-4c78-9b06-3498538e77ed tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 08b1b860-516e-4041-8df8-1fa8cc65a4ed] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:45.839711 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b30a0c30-c6b2-4c78-9b06-3498538e77ed tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:45.840436 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b30a0c30-c6b2-4c78-9b06-3498538e77ed tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:45.841391 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b30a0c30-c6b2-4c78-9b06-3498538e77ed tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:45.841823 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b30a0c30-c6b2-4c78-9b06-3498538e77ed tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:45.910180 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-b30a0c30-c6b2-4c78-9b06-3498538e77ed tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76e8d7bfdc04ea79c83ca7fb6b9ade1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5074cf3e6248668995f266845c8969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:45.920331 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-b30a0c30-c6b2-4c78-9b06-3498538e77ed tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed" status: 200 len: 1606 microversion: 2.1 time: 0.092557 May 30 12:08:45.921029 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 321/629] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:08:45 2022] GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed => generated 1606 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:46.453971 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-f45d48fa-d9e7-4ded-9baf-65d0da7c256d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:46.454560 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-f45d48fa-d9e7-4ded-9baf-65d0da7c256d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:46.460819 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f45d48fa-d9e7-4ded-9baf-65d0da7c256d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:46.461273 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f45d48fa-d9e7-4ded-9baf-65d0da7c256d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:46.462040 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f45d48fa-d9e7-4ded-9baf-65d0da7c256d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:46.462481 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f45d48fa-d9e7-4ded-9baf-65d0da7c256d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:46.505309 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell0:SELECT=6 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:08:46.596366 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-f45d48fa-d9e7-4ded-9baf-65d0da7c256d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:46.606142 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-f45d48fa-d9e7-4ded-9baf-65d0da7c256d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:46.607633 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-f45d48fa-d9e7-4ded-9baf-65d0da7c256d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:46.608765 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-f45d48fa-d9e7-4ded-9baf-65d0da7c256d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c" status: 200 len: 1406 microversion: 2.20 time: 0.159249 May 30 12:08:46.609338 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 309/630] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:08:46 2022] GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:08:46.938192 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-b415ab08-edcd-4bda-852b-076b3dbd014b tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:46.938840 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-b415ab08-edcd-4bda-852b-076b3dbd014b tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 08b1b860-516e-4041-8df8-1fa8cc65a4ed] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:46.940820 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell0:SELECT=2 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:08:46.941478 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell0:SELECT=6 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:08:46.949118 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b415ab08-edcd-4bda-852b-076b3dbd014b tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:46.949572 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b415ab08-edcd-4bda-852b-076b3dbd014b tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:46.950349 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b415ab08-edcd-4bda-852b-076b3dbd014b tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:46.950785 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b415ab08-edcd-4bda-852b-076b3dbd014b tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:47.022232 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-b415ab08-edcd-4bda-852b-076b3dbd014b tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76e8d7bfdc04ea79c83ca7fb6b9ade1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5074cf3e6248668995f266845c8969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:47.030333 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-b415ab08-edcd-4bda-852b-076b3dbd014b tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed" status: 200 len: 1322 microversion: 2.1 time: 0.095889 May 30 12:08:47.030909 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 322/631] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:08:46 2022] GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed => generated 1322 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:47.573120 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-0af6740a-d77d-4a51-8233-d0d01f92bb06 req-2e72c1f1-c758-4851-8921-104aa8994a3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0614f5df-431f-4955-acdb-05894441016c", "tag": "e2714e9d-b17a-42e1-8920-55a988a1b563"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:08:47.600466 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-0af6740a-d77d-4a51-8233-d0d01f92bb06 req-2e72c1f1-c758-4851-8921-104aa8994a3c service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:47.601042 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-0af6740a-d77d-4a51-8233-d0d01f92bb06 req-2e72c1f1-c758-4851-8921-104aa8994a3c service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:47.616558 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-0af6740a-d77d-4a51-8233-d0d01f92bb06 req-2e72c1f1-c758-4851-8921-104aa8994a3c service nova] Creating event network-changed:e2714e9d-b17a-42e1-8920-55a988a1b563 for instance 0614f5df-431f-4955-acdb-05894441016c on hv-cinder-84051 May 30 12:08:47.622232 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-0af6740a-d77d-4a51-8233-d0d01f92bb06 req-2e72c1f1-c758-4851-8921-104aa8994a3c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054465 May 30 12:08:47.623459 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 310/632] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:08:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 30 12:08:47.627330 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-5eef7e9b-9d3e-4e5a-9fc7-b54f591059e1 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:47.628039 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-5eef7e9b-9d3e-4e5a-9fc7-b54f591059e1 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:47.637122 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5eef7e9b-9d3e-4e5a-9fc7-b54f591059e1 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:47.637673 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5eef7e9b-9d3e-4e5a-9fc7-b54f591059e1 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:47.638524 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5eef7e9b-9d3e-4e5a-9fc7-b54f591059e1 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:47.639068 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5eef7e9b-9d3e-4e5a-9fc7-b54f591059e1 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:47.788767 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-5eef7e9b-9d3e-4e5a-9fc7-b54f591059e1 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:47.797010 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-5eef7e9b-9d3e-4e5a-9fc7-b54f591059e1 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:47.798502 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-5eef7e9b-9d3e-4e5a-9fc7-b54f591059e1 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:47.799799 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-5eef7e9b-9d3e-4e5a-9fc7-b54f591059e1 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c" status: 200 len: 1406 microversion: 2.20 time: 0.176767 May 30 12:08:47.800394 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 323/633] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:08:47 2022] GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c => generated 1406 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 30 12:08:48.047526 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-aaba6bc7-8ef9-441b-99bb-2aa27369e5c1 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:48.048183 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-aaba6bc7-8ef9-441b-99bb-2aa27369e5c1 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 08b1b860-516e-4041-8df8-1fa8cc65a4ed] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:48.054801 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-aaba6bc7-8ef9-441b-99bb-2aa27369e5c1 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:48.055250 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-aaba6bc7-8ef9-441b-99bb-2aa27369e5c1 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:48.056019 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-aaba6bc7-8ef9-441b-99bb-2aa27369e5c1 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:48.056478 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-aaba6bc7-8ef9-441b-99bb-2aa27369e5c1 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:48.060589 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell1:SELECT=100 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:08:48.071074 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.wsgi [None req-aaba6bc7-8ef9-441b-99bb-2aa27369e5c1 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] HTTP exception thrown: Instance 08b1b860-516e-4041-8df8-1fa8cc65a4ed could not be found. May 30 12:08:48.072728 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-aaba6bc7-8ef9-441b-99bb-2aa27369e5c1 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Request method failure captured: May 30 12:08:48.072728 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: request: GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed HTTP/1.1 May 30 12:08:48.072728 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Accept: application/json May 30 12:08:48.072728 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Accept-Encoding: identity May 30 12:08:48.072728 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Connection: close May 30 12:08:48.072728 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Content-Length: 0 May 30 12:08:48.072728 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Content-Type: application/json May 30 12:08:48.072728 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Host: 10.222.0.32 May 30 12:08:48.072728 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Openstack-System-Scope: None May 30 12:08:48.072728 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: User-Agent: python-urllib3/1.26.9 May 30 12:08:48.072728 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Auth-Token: gAAAAABilLK4IddkunCo0Xmjrms8ofv8_gpbvwTsl-mso90Gd-x4mCJoeDTHM6sXVesnqNGpnDpFAQG8d_YdpsH3sRAOPyTza0DMw9keL1RdMfuWo3t12sQTo4M7obVAI5TL8y9jPYTTnwfsh-ZnAj255hOWPH4AJlfv00aeUv7tlc7kqVzUCJk May 30 12:08:48.072728 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Domain-Id: None May 30 12:08:48.072728 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Domain-Name: None May 30 12:08:48.072728 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Identity-Status: Confirmed May 30 12:08:48.072728 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Is-Admin-Project: True May 30 12:08:48.072728 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Domain-Id: default May 30 12:08:48.072728 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Domain-Name: Default May 30 12:08:48.072728 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Id: 8b5074cf3e6248668995f266845c8969 May 30 12:08:48.072728 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Name: tempest-AttachVolumeTestJSON-836453923 May 30 12:08:48.072728 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Role: reader,member May 30 12:08:48.072728 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Roles: reader,member May 30 12:08:48.074349 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/8b5074cf3e6248668995f266845c8969"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/8b5074cf3e6248668995f266845c8969"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/8b5074cf3e6248668995f266845c8969"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_8b5074cf3e6248668995f266845c8969", "adminURL": "http://10.222.0.32:8080"}]}] May 30 12:08:48.074349 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant: tempest-AttachVolumeTestJSON-836453923 May 30 12:08:48.074349 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant-Id: 8b5074cf3e6248668995f266845c8969 May 30 12:08:48.074349 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant-Name: tempest-AttachVolumeTestJSON-836453923 May 30 12:08:48.074349 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User: tempest-AttachVolumeTestJSON-836453923-project May 30 12:08:48.074349 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Domain-Id: default May 30 12:08:48.074349 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Domain-Name: Default May 30 12:08:48.074349 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Id: c76e8d7bfdc04ea79c83ca7fb6b9ade1 May 30 12:08:48.074349 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Name: tempest-AttachVolumeTestJSON-836453923-project May 30 12:08:48.074349 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: method: > May 30 12:08:48.074349 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: exception: Instance 08b1b860-516e-4041-8df8-1fa8cc65a4ed could not be found. May 30 12:08:48.074349 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: action_args: {'id': '08b1b860-516e-4041-8df8-1fa8cc65a4ed'} May 30 12:08:48.075301 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:08:48.075301 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:08:48.075301 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:08:48.075301 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:08:48.075301 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:08:48.075301 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:08:48.075301 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:08:48.075301 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:08:48.075301 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:08:48.075301 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:08:48.075301 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08b1b860-516e-4041-8df8-1fa8cc65a4ed could not be found. May 30 12:08:48.075301 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:08:48.075301 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:08:48.075301 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:08:48.075301 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:08:48.075301 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:08:48.075301 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:08:48.075301 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:08:48.075301 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:08:48.075301 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:08:48.076847 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:08:48.076847 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 30 12:08:48.076847 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 30 12:08:48.076847 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 30 12:08:48.076847 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 30 12:08:48.076847 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:08:48.076847 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:08:48.076847 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08b1b860-516e-4041-8df8-1fa8cc65a4ed could not be found. May 30 12:08:48.076847 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:08:48.076847 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:08:48.076847 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:08:48.076847 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:08:48.076847 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:08:48.076847 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:08:48.076847 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:08:48.076847 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:08:48.076847 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08b1b860-516e-4041-8df8-1fa8cc65a4ed could not be found. May 30 12:08:48.076847 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:08:48.078196 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-aaba6bc7-8ef9-441b-99bb-2aa27369e5c1 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Returning 404 to user: Instance 08b1b860-516e-4041-8df8-1fa8cc65a4ed could not be found. {{(pid=117670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:08:48.078196 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-aaba6bc7-8ef9-441b-99bb-2aa27369e5c1 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed" status: 404 len: 111 microversion: 2.1 time: 0.030922 May 30 12:08:48.078196 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 311/634] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:08:48 2022] GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 30 12:08:48.084428 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-cc56acd2-2a11-4ce0-994e-598a5112efe3 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '.version_select at 0x7f0ef86e88b0>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:48.102266 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-cc56acd2-2a11-4ce0-994e-598a5112efe3 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2098804648" status: 202 len: 0 microversion: 2.1 time: 0.022568 May 30 12:08:48.102844 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 324/635] 10.222.0.32 () {58 vars in 1220 bytes} [Mon May 30 12:08:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2098804648 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 30 12:08:48.790233 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-d5a74757-689e-4d35-b1d6-c295603d5529 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Action: 'create', calling method: .version_select at 0x7f0ef86ef1f0>, body: {"keypair": {"name": "tempest-keypair-266343112", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBJjL+/6uQ9hYiSSjXmJWBlS0p3366VOoyMkpDRJB/yNV32EBvlBh+uG2hAFj74mzLmUnMMxeAVbYofyW3JJKxF4SO/Ue8/VhWsBJ9V69UFHIDpLiFVrZJrSJoEZh/AqRw=="}} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:08:48.816741 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.quota [None req-d5a74757-689e-4d35-b1d6-c295603d5529 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Getting quotas for project 8b5074cf3e6248668995f266845c8969. Resources: {'key_pairs'} {{(pid=117670) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 30 12:08:48.818844 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-f7b318c4-2874-474b-9f74-130455a0562a tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:48.820288 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-f7b318c4-2874-474b-9f74-130455a0562a tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:48.821227 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.quota [None req-d5a74757-689e-4d35-b1d6-c295603d5529 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Getting quotas for user c76e8d7bfdc04ea79c83ca7fb6b9ade1 and project 8b5074cf3e6248668995f266845c8969. Resources: {'key_pairs'} {{(pid=117670) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 30 12:08:48.828294 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f7b318c4-2874-474b-9f74-130455a0562a tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:48.828752 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f7b318c4-2874-474b-9f74-130455a0562a tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:48.829571 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f7b318c4-2874-474b-9f74-130455a0562a tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:48.830371 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f7b318c4-2874-474b-9f74-130455a0562a tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:48.853986 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-d5a74757-689e-4d35-b1d6-c295603d5529 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.068110 May 30 12:08:48.855735 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 312/636] 10.222.0.32 () {60 vars in 1158 bytes} [Mon May 30 12:08:48 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:08:48.987712 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-f7b318c4-2874-474b-9f74-130455a0562a tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:48.990607 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:08:48.998843 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-f7b318c4-2874-474b-9f74-130455a0562a tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:49.000390 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-f7b318c4-2874-474b-9f74-130455a0562a tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:49.001513 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-f7b318c4-2874-474b-9f74-130455a0562a tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c" status: 200 len: 1406 microversion: 2.20 time: 0.186978 May 30 12:08:49.002082 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 325/637] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:08:48 2022] GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c => generated 1406 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:08:50.022890 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-251b7880-863a-4fe0-8c3c-42fef6caa6fb tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:50.024518 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-251b7880-863a-4fe0-8c3c-42fef6caa6fb tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:50.041120 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-251b7880-863a-4fe0-8c3c-42fef6caa6fb tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:50.041698 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-251b7880-863a-4fe0-8c3c-42fef6caa6fb tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:50.042511 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-251b7880-863a-4fe0-8c3c-42fef6caa6fb tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:50.043022 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-251b7880-863a-4fe0-8c3c-42fef6caa6fb tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:50.266267 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-251b7880-863a-4fe0-8c3c-42fef6caa6fb tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:50.275330 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-251b7880-863a-4fe0-8c3c-42fef6caa6fb tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:50.276887 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-251b7880-863a-4fe0-8c3c-42fef6caa6fb tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:50.278005 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-251b7880-863a-4fe0-8c3c-42fef6caa6fb tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c" status: 200 len: 1406 microversion: 2.20 time: 0.260568 May 30 12:08:50.278566 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 313/638] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:08:50 2022] GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c => generated 1406 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:08:50.359135 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-ef629deb-d1d0-4884-9a32-ec2341217cf9 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1304920555", "imageRef": "b8ef93ed-af98-4d8c-9e1d-43d7b1f2b832", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e532e692-bceb-4466-adae-3cc4239d2d96"}], "security_groups": [{"name": "tempest-securitygroup--2135438754"}], "key_name": "tempest-keypair-266343112", "user_data": "}} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:08:50.462016 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.network.neutron [None req-ef629deb-d1d0-4884-9a32-ec2341217cf9 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] validate_networks() for [('e532e692-bceb-4466-adae-3cc4239d2d96', None, None, None, None, None)] {{(pid=117671) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 30 12:08:50.841891 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-ef629deb-d1d0-4884-9a32-ec2341217cf9 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Flavor limits 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 30 12:08:50.842320 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-ef629deb-d1d0-4884-9a32-ec2341217cf9 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Image limits 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 30 12:08:50.842792 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-ef629deb-d1d0-4884-9a32-ec2341217cf9 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Flavor pref 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 30 12:08:50.843195 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-ef629deb-d1d0-4884-9a32-ec2341217cf9 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Image pref 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 30 12:08:50.843603 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-ef629deb-d1d0-4884-9a32-ec2341217cf9 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 30 12:08:50.853174 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ef629deb-d1d0-4884-9a32-ec2341217cf9 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:50.853616 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ef629deb-d1d0-4884-9a32-ec2341217cf9 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:50.854419 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ef629deb-d1d0-4884-9a32-ec2341217cf9 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:50.854867 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ef629deb-d1d0-4884-9a32-ec2341217cf9 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:50.872586 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.quota [None req-ef629deb-d1d0-4884-9a32-ec2341217cf9 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Getting quotas for project 8b5074cf3e6248668995f266845c8969. Resources: {'cores', 'instances', 'ram'} {{(pid=117671) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 30 12:08:50.877243 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.quota [None req-ef629deb-d1d0-4884-9a32-ec2341217cf9 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Getting quotas for user c76e8d7bfdc04ea79c83ca7fb6b9ade1 and project 8b5074cf3e6248668995f266845c8969. Resources: {'cores', 'instances', 'ram'} {{(pid=117671) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 30 12:08:50.888566 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-ef629deb-d1d0-4884-9a32-ec2341217cf9 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Going to run 1 instances... {{(pid=117671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 30 12:08:50.890838 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-ef629deb-d1d0-4884-9a32-ec2341217cf9 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 9c81cc0f-7430-4246-a05e-4670433f04ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b8ef93ed-af98-4d8c-9e1d-43d7b1f2b832',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 30 12:08:50.938110 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-ef629deb-d1d0-4884-9a32-ec2341217cf9 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.583808 May 30 12:08:50.938672 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 326/639] 10.222.0.32 () {60 vars in 1146 bytes} [Mon May 30 12:08:50 2022] POST /compute/v2.1/servers => generated 402 bytes in 585 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 30 12:08:50.948798 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-ac60c396-92f4-4565-a174-5d899b1063ee tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:50.949448 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-ac60c396-92f4-4565-a174-5d899b1063ee tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 9c81cc0f-7430-4246-a05e-4670433f04ac] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:51.003286 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-ac60c396-92f4-4565-a174-5d899b1063ee tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76e8d7bfdc04ea79c83ca7fb6b9ade1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5074cf3e6248668995f266845c8969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:51.010267 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-ac60c396-92f4-4565-a174-5d899b1063ee tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/9c81cc0f-7430-4246-a05e-4670433f04ac" status: 200 len: 1237 microversion: 2.1 time: 0.065337 May 30 12:08:51.010922 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 314/640] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:08:50 2022] GET /compute/v2.1/servers/9c81cc0f-7430-4246-a05e-4670433f04ac => generated 1237 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:51.296066 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-49909c6b-8384-4dc6-880a-b97a6474ce18 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:51.296656 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-49909c6b-8384-4dc6-880a-b97a6474ce18 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:51.302869 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-49909c6b-8384-4dc6-880a-b97a6474ce18 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:51.303303 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-49909c6b-8384-4dc6-880a-b97a6474ce18 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:51.304064 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-49909c6b-8384-4dc6-880a-b97a6474ce18 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:51.304527 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-49909c6b-8384-4dc6-880a-b97a6474ce18 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:51.440860 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-49909c6b-8384-4dc6-880a-b97a6474ce18 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:51.449818 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-49909c6b-8384-4dc6-880a-b97a6474ce18 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:51.451292 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-49909c6b-8384-4dc6-880a-b97a6474ce18 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:51.452406 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-49909c6b-8384-4dc6-880a-b97a6474ce18 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c" status: 200 len: 1406 microversion: 2.20 time: 0.160434 May 30 12:08:51.452956 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 327/641] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:08:51 2022] GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:08:52.027418 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-76e5feca-d7b1-42cc-8ccf-8efb6f3ccc11 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:52.028342 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-76e5feca-d7b1-42cc-8ccf-8efb6f3ccc11 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 9c81cc0f-7430-4246-a05e-4670433f04ac] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:52.035462 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-76e5feca-d7b1-42cc-8ccf-8efb6f3ccc11 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:52.036022 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-76e5feca-d7b1-42cc-8ccf-8efb6f3ccc11 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:52.042631 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-76e5feca-d7b1-42cc-8ccf-8efb6f3ccc11 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:52.043531 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-76e5feca-d7b1-42cc-8ccf-8efb6f3ccc11 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:52.129901 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-76e5feca-d7b1-42cc-8ccf-8efb6f3ccc11 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76e8d7bfdc04ea79c83ca7fb6b9ade1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5074cf3e6248668995f266845c8969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:52.130365 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-72f329b5-3615-471e-b288-7e10818ba79b req-ee8ab9fc-7eb1-4617-b7d6-b11352309467 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0614f5df-431f-4955-acdb-05894441016c", "name": "network-vif-plugged", "status": "completed", "tag": "e2714e9d-b17a-42e1-8920-55a988a1b563"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:08:52.139763 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-76e5feca-d7b1-42cc-8ccf-8efb6f3ccc11 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/9c81cc0f-7430-4246-a05e-4670433f04ac" status: 200 len: 1295 microversion: 2.1 time: 0.116510 May 30 12:08:52.140883 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-72f329b5-3615-471e-b288-7e10818ba79b req-ee8ab9fc-7eb1-4617-b7d6-b11352309467 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:52.141828 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-72f329b5-3615-471e-b288-7e10818ba79b req-ee8ab9fc-7eb1-4617-b7d6-b11352309467 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:52.150716 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 315/642] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:08:52 2022] GET /compute/v2.1/servers/9c81cc0f-7430-4246-a05e-4670433f04ac => generated 1295 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:52.163025 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-72f329b5-3615-471e-b288-7e10818ba79b req-ee8ab9fc-7eb1-4617-b7d6-b11352309467 service nova] Creating event network-vif-plugged:e2714e9d-b17a-42e1-8920-55a988a1b563 for instance 0614f5df-431f-4955-acdb-05894441016c on hv-cinder-84051 May 30 12:08:52.172431 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-72f329b5-3615-471e-b288-7e10818ba79b req-ee8ab9fc-7eb1-4617-b7d6-b11352309467 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041870 May 30 12:08:52.174225 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 328/643] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:08:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:08:52.471619 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-d4b6cff5-cee0-40af-bb3e-ba2f8a7dbe8f tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:52.472333 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-d4b6cff5-cee0-40af-bb3e-ba2f8a7dbe8f tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:52.479133 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d4b6cff5-cee0-40af-bb3e-ba2f8a7dbe8f tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:52.479586 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d4b6cff5-cee0-40af-bb3e-ba2f8a7dbe8f tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:52.480399 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d4b6cff5-cee0-40af-bb3e-ba2f8a7dbe8f tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:52.480839 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d4b6cff5-cee0-40af-bb3e-ba2f8a7dbe8f tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:52.622624 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-d4b6cff5-cee0-40af-bb3e-ba2f8a7dbe8f tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:52.630770 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-d4b6cff5-cee0-40af-bb3e-ba2f8a7dbe8f tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:52.632444 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-d4b6cff5-cee0-40af-bb3e-ba2f8a7dbe8f tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:52.633563 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-d4b6cff5-cee0-40af-bb3e-ba2f8a7dbe8f tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c" status: 200 len: 1406 microversion: 2.20 time: 0.166899 May 30 12:08:52.634157 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 316/644] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:08:52 2022] GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 30 12:08:53.157800 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-73674bd7-2215-4ad7-8bc3-e6b4ea435fe0 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:53.158639 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-73674bd7-2215-4ad7-8bc3-e6b4ea435fe0 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 9c81cc0f-7430-4246-a05e-4670433f04ac] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:53.165450 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-73674bd7-2215-4ad7-8bc3-e6b4ea435fe0 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:53.165900 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-73674bd7-2215-4ad7-8bc3-e6b4ea435fe0 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:53.166674 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-73674bd7-2215-4ad7-8bc3-e6b4ea435fe0 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:53.167107 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-73674bd7-2215-4ad7-8bc3-e6b4ea435fe0 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:53.308024 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-73674bd7-2215-4ad7-8bc3-e6b4ea435fe0 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76e8d7bfdc04ea79c83ca7fb6b9ade1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5074cf3e6248668995f266845c8969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:53.316753 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-73674bd7-2215-4ad7-8bc3-e6b4ea435fe0 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/9c81cc0f-7430-4246-a05e-4670433f04ac" status: 200 len: 1363 microversion: 2.1 time: 0.163091 May 30 12:08:53.317853 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 329/645] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:08:53 2022] GET /compute/v2.1/servers/9c81cc0f-7430-4246-a05e-4670433f04ac => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:08:53.471980 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-00801e4d-05ad-4df7-ad12-d0c19f9ab859 req-873bfa16-6a1c-4b8c-b501-1611c4f613f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c81cc0f-7430-4246-a05e-4670433f04ac", "tag": "f11c8f02-5789-4508-b902-db1e07686c56"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:08:53.483151 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-00801e4d-05ad-4df7-ad12-d0c19f9ab859 req-873bfa16-6a1c-4b8c-b501-1611c4f613f4 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:53.483327 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-00801e4d-05ad-4df7-ad12-d0c19f9ab859 req-873bfa16-6a1c-4b8c-b501-1611c4f613f4 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:53.497618 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-00801e4d-05ad-4df7-ad12-d0c19f9ab859 req-873bfa16-6a1c-4b8c-b501-1611c4f613f4 service nova] Creating event network-changed:f11c8f02-5789-4508-b902-db1e07686c56 for instance 9c81cc0f-7430-4246-a05e-4670433f04ac on hv-cinder-84051 May 30 12:08:53.502627 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-00801e4d-05ad-4df7-ad12-d0c19f9ab859 req-873bfa16-6a1c-4b8c-b501-1611c4f613f4 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034489 May 30 12:08:53.503231 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 317/646] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:08:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:08:53.652049 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-36bee3b7-0599-46bc-8205-fce420567b85 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:53.652821 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-36bee3b7-0599-46bc-8205-fce420567b85 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:53.659162 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-36bee3b7-0599-46bc-8205-fce420567b85 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:53.659690 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-36bee3b7-0599-46bc-8205-fce420567b85 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:53.660538 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-36bee3b7-0599-46bc-8205-fce420567b85 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:53.661572 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-36bee3b7-0599-46bc-8205-fce420567b85 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:53.807619 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-36bee3b7-0599-46bc-8205-fce420567b85 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:53.815883 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-36bee3b7-0599-46bc-8205-fce420567b85 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:53.818125 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-36bee3b7-0599-46bc-8205-fce420567b85 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:53.819253 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-36bee3b7-0599-46bc-8205-fce420567b85 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c" status: 200 len: 1406 microversion: 2.20 time: 0.171138 May 30 12:08:53.819821 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 330/647] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:08:53 2022] GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:08:54.335910 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-33b39172-c6ec-4e62-90d4-a45efae8777d tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:54.336931 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-33b39172-c6ec-4e62-90d4-a45efae8777d tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 9c81cc0f-7430-4246-a05e-4670433f04ac] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:54.343718 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-33b39172-c6ec-4e62-90d4-a45efae8777d tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:54.344491 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-33b39172-c6ec-4e62-90d4-a45efae8777d tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:54.345549 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-33b39172-c6ec-4e62-90d4-a45efae8777d tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:54.346080 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-33b39172-c6ec-4e62-90d4-a45efae8777d tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:54.485139 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-33b39172-c6ec-4e62-90d4-a45efae8777d tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76e8d7bfdc04ea79c83ca7fb6b9ade1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5074cf3e6248668995f266845c8969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:54.493595 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-33b39172-c6ec-4e62-90d4-a45efae8777d tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/9c81cc0f-7430-4246-a05e-4670433f04ac" status: 200 len: 1363 microversion: 2.1 time: 0.162877 May 30 12:08:54.494175 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 318/648] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:08:54 2022] GET /compute/v2.1/servers/9c81cc0f-7430-4246-a05e-4670433f04ac => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:54.836483 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-78a2d0cf-32ed-48b1-a56d-0493094ad773 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:54.837101 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-78a2d0cf-32ed-48b1-a56d-0493094ad773 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:54.843641 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-78a2d0cf-32ed-48b1-a56d-0493094ad773 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:54.844028 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-78a2d0cf-32ed-48b1-a56d-0493094ad773 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:54.844830 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-78a2d0cf-32ed-48b1-a56d-0493094ad773 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:54.845270 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-78a2d0cf-32ed-48b1-a56d-0493094ad773 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:54.977696 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-78a2d0cf-32ed-48b1-a56d-0493094ad773 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:54.985818 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-78a2d0cf-32ed-48b1-a56d-0493094ad773 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:54.987356 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-78a2d0cf-32ed-48b1-a56d-0493094ad773 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:54.988591 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-78a2d0cf-32ed-48b1-a56d-0493094ad773 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c" status: 200 len: 1597 microversion: 2.20 time: 0.156258 May 30 12:08:54.989862 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 331/649] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:08:54 2022] GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c => generated 1597 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:08:55.007311 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-343d6ea7-fe5b-4c0c-9bd0-2abe8de1b2e2 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:55.007807 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-343d6ea7-fe5b-4c0c-9bd0-2abe8de1b2e2 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:55.009801 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=1,nova_api:INSERT=2 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:08:55.015345 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-343d6ea7-fe5b-4c0c-9bd0-2abe8de1b2e2 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:55.015802 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-343d6ea7-fe5b-4c0c-9bd0-2abe8de1b2e2 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:55.016606 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-343d6ea7-fe5b-4c0c-9bd0-2abe8de1b2e2 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:55.017045 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-343d6ea7-fe5b-4c0c-9bd0-2abe8de1b2e2 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:55.094676 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-343d6ea7-fe5b-4c0c-9bd0-2abe8de1b2e2 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.091913 May 30 12:08:55.095542 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 319/650] 10.222.0.32 () {60 vars in 1315 bytes} [Mon May 30 12:08:55 2022] GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 30 12:08:55.512407 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-6655f4b8-12e4-4b70-a481-a72efe62fe94 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:55.513223 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-6655f4b8-12e4-4b70-a481-a72efe62fe94 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 9c81cc0f-7430-4246-a05e-4670433f04ac] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:55.519710 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-6655f4b8-12e4-4b70-a481-a72efe62fe94 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:55.520752 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-6655f4b8-12e4-4b70-a481-a72efe62fe94 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:55.521873 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-6655f4b8-12e4-4b70-a481-a72efe62fe94 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:55.522377 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-6655f4b8-12e4-4b70-a481-a72efe62fe94 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:55.751935 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-6655f4b8-12e4-4b70-a481-a72efe62fe94 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76e8d7bfdc04ea79c83ca7fb6b9ade1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5074cf3e6248668995f266845c8969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:55.760865 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-6655f4b8-12e4-4b70-a481-a72efe62fe94 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/9c81cc0f-7430-4246-a05e-4670433f04ac" status: 200 len: 1363 microversion: 2.1 time: 0.254707 May 30 12:08:55.761552 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 332/651] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:08:55 2022] GET /compute/v2.1/servers/9c81cc0f-7430-4246-a05e-4670433f04ac => generated 1363 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:08:56.122046 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-ac3e8bd6-caef-4d5c-814d-d5115088fda1 req-cdd18556-9f7a-4a78-8d3c-be21cdec1a08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0614f5df-431f-4955-acdb-05894441016c", "tag": "e2714e9d-b17a-42e1-8920-55a988a1b563"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:08:56.131878 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-ac3e8bd6-caef-4d5c-814d-d5115088fda1 req-cdd18556-9f7a-4a78-8d3c-be21cdec1a08 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:56.132366 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-ac3e8bd6-caef-4d5c-814d-d5115088fda1 req-cdd18556-9f7a-4a78-8d3c-be21cdec1a08 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:56.144834 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-ac3e8bd6-caef-4d5c-814d-d5115088fda1 req-cdd18556-9f7a-4a78-8d3c-be21cdec1a08 service nova] Creating event network-changed:e2714e9d-b17a-42e1-8920-55a988a1b563 for instance 0614f5df-431f-4955-acdb-05894441016c on hv-cinder-84051 May 30 12:08:56.150636 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-ac3e8bd6-caef-4d5c-814d-d5115088fda1 req-cdd18556-9f7a-4a78-8d3c-be21cdec1a08 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032740 May 30 12:08:56.151315 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 320/652] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:08:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:08:56.778606 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-d1dcb5b3-242f-4e23-beb1-ebf54e7ad6e1 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:56.779225 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-d1dcb5b3-242f-4e23-beb1-ebf54e7ad6e1 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 9c81cc0f-7430-4246-a05e-4670433f04ac] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:56.785956 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d1dcb5b3-242f-4e23-beb1-ebf54e7ad6e1 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:56.786424 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d1dcb5b3-242f-4e23-beb1-ebf54e7ad6e1 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:56.787278 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d1dcb5b3-242f-4e23-beb1-ebf54e7ad6e1 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:56.787720 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d1dcb5b3-242f-4e23-beb1-ebf54e7ad6e1 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:56.929417 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-d1dcb5b3-242f-4e23-beb1-ebf54e7ad6e1 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76e8d7bfdc04ea79c83ca7fb6b9ade1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5074cf3e6248668995f266845c8969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:56.937237 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-d1dcb5b3-242f-4e23-beb1-ebf54e7ad6e1 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/9c81cc0f-7430-4246-a05e-4670433f04ac" status: 200 len: 1363 microversion: 2.1 time: 0.162510 May 30 12:08:56.937905 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 333/653] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:08:56 2022] GET /compute/v2.1/servers/9c81cc0f-7430-4246-a05e-4670433f04ac => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:57.956044 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-9adf580d-dc8c-4c02-a5f1-69af05ddebf4 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:57.956683 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-9adf580d-dc8c-4c02-a5f1-69af05ddebf4 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 9c81cc0f-7430-4246-a05e-4670433f04ac] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:57.968913 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9adf580d-dc8c-4c02-a5f1-69af05ddebf4 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:57.969367 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9adf580d-dc8c-4c02-a5f1-69af05ddebf4 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:57.970141 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9adf580d-dc8c-4c02-a5f1-69af05ddebf4 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:57.970583 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9adf580d-dc8c-4c02-a5f1-69af05ddebf4 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:58.166985 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-6feb4bb6-60fd-466a-adf3-07ffa5891062 req-0a157afe-52f2-4b7d-8850-e8b52e0bfdcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c81cc0f-7430-4246-a05e-4670433f04ac", "name": "network-vif-plugged", "status": "completed", "tag": "f11c8f02-5789-4508-b902-db1e07686c56"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:08:58.179774 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-6feb4bb6-60fd-466a-adf3-07ffa5891062 req-0a157afe-52f2-4b7d-8850-e8b52e0bfdcd service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:58.180525 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-6feb4bb6-60fd-466a-adf3-07ffa5891062 req-0a157afe-52f2-4b7d-8850-e8b52e0bfdcd service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:58.197123 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-6feb4bb6-60fd-466a-adf3-07ffa5891062 req-0a157afe-52f2-4b7d-8850-e8b52e0bfdcd service nova] Creating event network-vif-plugged:f11c8f02-5789-4508-b902-db1e07686c56 for instance 9c81cc0f-7430-4246-a05e-4670433f04ac on hv-cinder-84051 May 30 12:08:58.202987 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-6feb4bb6-60fd-466a-adf3-07ffa5891062 req-0a157afe-52f2-4b7d-8850-e8b52e0bfdcd service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039956 May 30 12:08:58.203827 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 334/654] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:08:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:08:58.289244 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-9adf580d-dc8c-4c02-a5f1-69af05ddebf4 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76e8d7bfdc04ea79c83ca7fb6b9ade1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5074cf3e6248668995f266845c8969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:58.297113 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-9adf580d-dc8c-4c02-a5f1-69af05ddebf4 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/9c81cc0f-7430-4246-a05e-4670433f04ac" status: 200 len: 1363 microversion: 2.1 time: 0.345847 May 30 12:08:58.297788 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 321/655] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:08:57 2022] GET /compute/v2.1/servers/9c81cc0f-7430-4246-a05e-4670433f04ac => generated 1363 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:59.315415 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-8ab25fa4-0b8a-4cad-951b-4204f28aa2f5 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:59.316111 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-8ab25fa4-0b8a-4cad-951b-4204f28aa2f5 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 9c81cc0f-7430-4246-a05e-4670433f04ac] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:59.322581 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8ab25fa4-0b8a-4cad-951b-4204f28aa2f5 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:59.323020 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8ab25fa4-0b8a-4cad-951b-4204f28aa2f5 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:59.323829 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8ab25fa4-0b8a-4cad-951b-4204f28aa2f5 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:59.324287 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8ab25fa4-0b8a-4cad-951b-4204f28aa2f5 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:59.461019 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-8ab25fa4-0b8a-4cad-951b-4204f28aa2f5 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76e8d7bfdc04ea79c83ca7fb6b9ade1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5074cf3e6248668995f266845c8969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:59.468419 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-8ab25fa4-0b8a-4cad-951b-4204f28aa2f5 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/9c81cc0f-7430-4246-a05e-4670433f04ac" status: 200 len: 1363 microversion: 2.1 time: 0.157612 May 30 12:08:59.468988 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 335/656] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:08:59 2022] GET /compute/v2.1/servers/9c81cc0f-7430-4246-a05e-4670433f04ac => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:00.485944 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-b1f16314-056a-42cc-9b6f-33e7566022e7 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:00.486557 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-b1f16314-056a-42cc-9b6f-33e7566022e7 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 9c81cc0f-7430-4246-a05e-4670433f04ac] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:00.493256 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b1f16314-056a-42cc-9b6f-33e7566022e7 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:00.493709 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b1f16314-056a-42cc-9b6f-33e7566022e7 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:00.494477 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b1f16314-056a-42cc-9b6f-33e7566022e7 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:00.494915 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b1f16314-056a-42cc-9b6f-33e7566022e7 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:00.626560 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-b1f16314-056a-42cc-9b6f-33e7566022e7 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76e8d7bfdc04ea79c83ca7fb6b9ade1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5074cf3e6248668995f266845c8969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:00.634146 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-b1f16314-056a-42cc-9b6f-33e7566022e7 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/9c81cc0f-7430-4246-a05e-4670433f04ac" status: 200 len: 1550 microversion: 2.1 time: 0.152287 May 30 12:09:00.634694 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 322/657] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:09:00 2022] GET /compute/v2.1/servers/9c81cc0f-7430-4246-a05e-4670433f04ac => generated 1550 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:00.650609 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-cfdce9c5-7121-42cc-ad6b-314a58190518 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:00.651149 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-cfdce9c5-7121-42cc-ad6b-314a58190518 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 9c81cc0f-7430-4246-a05e-4670433f04ac] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:00.657666 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-cfdce9c5-7121-42cc-ad6b-314a58190518 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:00.658118 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-cfdce9c5-7121-42cc-ad6b-314a58190518 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:00.658883 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-cfdce9c5-7121-42cc-ad6b-314a58190518 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:00.659321 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-cfdce9c5-7121-42cc-ad6b-314a58190518 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:00.735183 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-cfdce9c5-7121-42cc-ad6b-314a58190518 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/9c81cc0f-7430-4246-a05e-4670433f04ac/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088367 May 30 12:09:00.735817 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 336/658] 10.222.0.32 () {58 vars in 1274 bytes} [Mon May 30 12:09:00 2022] GET /compute/v2.1/servers/9c81cc0f-7430-4246-a05e-4670433f04ac/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:09:01.898509 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-45f21b8d-c520-4b46-869d-60e1b4e7aaff req-f8ddace5-2b09-4d96-9fa1-c06e70d5ae56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c81cc0f-7430-4246-a05e-4670433f04ac", "tag": "f11c8f02-5789-4508-b902-db1e07686c56"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:09:01.901981 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell0:SELECT=6 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:09:01.908376 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-45f21b8d-c520-4b46-869d-60e1b4e7aaff req-f8ddace5-2b09-4d96-9fa1-c06e70d5ae56 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:01.908933 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-45f21b8d-c520-4b46-869d-60e1b4e7aaff req-f8ddace5-2b09-4d96-9fa1-c06e70d5ae56 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:01.920976 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-45f21b8d-c520-4b46-869d-60e1b4e7aaff req-f8ddace5-2b09-4d96-9fa1-c06e70d5ae56 service nova] Creating event network-changed:f11c8f02-5789-4508-b902-db1e07686c56 for instance 9c81cc0f-7430-4246-a05e-4670433f04ac on hv-cinder-84051 May 30 12:09:01.926653 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-45f21b8d-c520-4b46-869d-60e1b4e7aaff req-f8ddace5-2b09-4d96-9fa1-c06e70d5ae56 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031791 May 30 12:09:01.927772 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 323/659] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:09:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:09:09.767288 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell0:SELECT=2 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:09:09.768058 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell0:SELECT=6 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:09:09.773876 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-1e501bb0-09f4-4381-b7ef-d852107aa68a tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:09.774370 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-1e501bb0-09f4-4381-b7ef-d852107aa68a tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 83f672fe-d699-4f70-bc26-74dced714a5d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:09.781291 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1e501bb0-09f4-4381-b7ef-d852107aa68a tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:09.781743 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1e501bb0-09f4-4381-b7ef-d852107aa68a tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:09.782511 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1e501bb0-09f4-4381-b7ef-d852107aa68a tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:09.782953 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1e501bb0-09f4-4381-b7ef-d852107aa68a tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:10.065709 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.objects.instance [None req-1e501bb0-09f4-4381-b7ef-d852107aa68a tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lazy-loading 'services' on Instance uuid 83f672fe-d699-4f70-bc26-74dced714a5d {{(pid=117671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 30 12:09:10.138011 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-1e501bb0-09f4-4381-b7ef-d852107aa68a tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "DELETE /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d/os-volume_attachments/4ae317b9-5467-4b66-acdd-880a45951304" status: 202 len: 0 microversion: 2.1 time: 0.371159 May 30 12:09:10.138674 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 337/660] 10.222.0.32 () {58 vars in 1415 bytes} [Mon May 30 12:09:09 2022] DELETE /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d/os-volume_attachments/4ae317b9-5467-4b66-acdd-880a45951304 => generated 0 bytes in 373 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 30 12:09:10.148389 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-8f8306e3-e0f3-41d0-9694-1ab643bf3a26 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:10.149392 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-8f8306e3-e0f3-41d0-9694-1ab643bf3a26 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 83f672fe-d699-4f70-bc26-74dced714a5d] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:10.156310 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8f8306e3-e0f3-41d0-9694-1ab643bf3a26 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:10.156759 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8f8306e3-e0f3-41d0-9694-1ab643bf3a26 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:10.157524 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8f8306e3-e0f3-41d0-9694-1ab643bf3a26 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:10.157955 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8f8306e3-e0f3-41d0-9694-1ab643bf3a26 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:10.189753 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-8f8306e3-e0f3-41d0-9694-1ab643bf3a26 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046399 May 30 12:09:10.190306 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 324/661] 10.222.0.32 () {58 vars in 1301 bytes} [Mon May 30 12:09:10 2022] GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:09:11.202743 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-326c91c2-ddc2-4a93-a1f8-cb58cc82b676 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:11.203761 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-326c91c2-ddc2-4a93-a1f8-cb58cc82b676 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 83f672fe-d699-4f70-bc26-74dced714a5d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:11.211122 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-326c91c2-ddc2-4a93-a1f8-cb58cc82b676 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:11.211562 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-326c91c2-ddc2-4a93-a1f8-cb58cc82b676 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:11.212347 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-326c91c2-ddc2-4a93-a1f8-cb58cc82b676 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:11.212776 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-326c91c2-ddc2-4a93-a1f8-cb58cc82b676 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:11.243828 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-326c91c2-ddc2-4a93-a1f8-cb58cc82b676 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045593 May 30 12:09:11.244855 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 338/662] 10.222.0.32 () {58 vars in 1301 bytes} [Mon May 30 12:09:11 2022] GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 30 12:09:11.324880 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-6fb286c8-6b12-456d-8849-5f91d3255974 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:11.325443 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-6fb286c8-6b12-456d-8849-5f91d3255974 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 83f672fe-d699-4f70-bc26-74dced714a5d] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:11.332495 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6fb286c8-6b12-456d-8849-5f91d3255974 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:11.332957 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6fb286c8-6b12-456d-8849-5f91d3255974 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:11.335673 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6fb286c8-6b12-456d-8849-5f91d3255974 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:11.335673 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6fb286c8-6b12-456d-8849-5f91d3255974 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:11.360290 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-6fb286c8-6b12-456d-8849-5f91d3255974 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 83f672fe-d699-4f70-bc26-74dced714a5d] Going to try to terminate instance {{(pid=117670) delete /opt/stack/nova/nova/compute/api.py:2664}} May 30 12:09:11.435814 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-6fb286c8-6b12-456d-8849-5f91d3255974 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "DELETE /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d" status: 204 len: 0 microversion: 2.1 time: 0.114493 May 30 12:09:11.440016 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 325/663] 10.222.0.32 () {58 vars in 1238 bytes} [Mon May 30 12:09:11 2022] DELETE /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 30 12:09:11.445609 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-134c5665-141b-480d-88ec-4b5e6519d132 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:11.446214 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-134c5665-141b-480d-88ec-4b5e6519d132 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 83f672fe-d699-4f70-bc26-74dced714a5d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:11.452132 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-134c5665-141b-480d-88ec-4b5e6519d132 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:11.452607 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-134c5665-141b-480d-88ec-4b5e6519d132 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:11.453409 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-134c5665-141b-480d-88ec-4b5e6519d132 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:11.453784 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-134c5665-141b-480d-88ec-4b5e6519d132 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:11.586509 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-134c5665-141b-480d-88ec-4b5e6519d132 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:11.594161 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-134c5665-141b-480d-88ec-4b5e6519d132 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d" status: 200 len: 1691 microversion: 2.1 time: 0.152857 May 30 12:09:11.594734 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 339/664] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:09:11 2022] GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d => generated 1691 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:11.969348 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-00ab18f3-7b13-4b85-8767-87a9f616f542 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:11.969940 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-00ab18f3-7b13-4b85-8767-87a9f616f542 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: ed036712-bf1c-4eaa-9736-b486dc1f76bf] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:11.976049 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-00ab18f3-7b13-4b85-8767-87a9f616f542 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:11.976528 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-00ab18f3-7b13-4b85-8767-87a9f616f542 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:11.977299 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-00ab18f3-7b13-4b85-8767-87a9f616f542 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:11.977737 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-00ab18f3-7b13-4b85-8767-87a9f616f542 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:12.001094 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-00ab18f3-7b13-4b85-8767-87a9f616f542 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/ed036712-bf1c-4eaa-9736-b486dc1f76bf/ips" status: 200 len: 150 microversion: 2.1 time: 0.036053 May 30 12:09:12.001663 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 326/665] 10.222.0.32 () {58 vars in 1247 bytes} [Mon May 30 12:09:11 2022] GET /compute/v2.1/servers/ed036712-bf1c-4eaa-9736-b486dc1f76bf/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:09:12.617536 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-8ef23412-a5fb-49a8-9d55-f6c91899deb5 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:12.618150 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-8ef23412-a5fb-49a8-9d55-f6c91899deb5 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 83f672fe-d699-4f70-bc26-74dced714a5d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:12.624727 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8ef23412-a5fb-49a8-9d55-f6c91899deb5 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:12.625187 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8ef23412-a5fb-49a8-9d55-f6c91899deb5 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:12.625951 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8ef23412-a5fb-49a8-9d55-f6c91899deb5 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:12.626390 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8ef23412-a5fb-49a8-9d55-f6c91899deb5 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:12.761189 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-8ef23412-a5fb-49a8-9d55-f6c91899deb5 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:12.768940 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-8ef23412-a5fb-49a8-9d55-f6c91899deb5 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d" status: 200 len: 1691 microversion: 2.1 time: 0.156219 May 30 12:09:12.770167 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 340/666] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:09:12 2022] GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d => generated 1691 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:13.324365 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-27a6a638-ac7b-4704-bb1d-17b04615e019 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b92d796d-05f7-48ce-865d-f31f3e72acc0"}} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:09:13.325418 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-27a6a638-ac7b-4704-bb1d-17b04615e019 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: ed036712-bf1c-4eaa-9736-b486dc1f76bf] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:13.332485 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-27a6a638-ac7b-4704-bb1d-17b04615e019 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:13.333283 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-27a6a638-ac7b-4704-bb1d-17b04615e019 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:13.334072 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-27a6a638-ac7b-4704-bb1d-17b04615e019 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:13.334504 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-27a6a638-ac7b-4704-bb1d-17b04615e019 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:13.786582 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-90d9240d-3990-4e5c-ae2e-4af56480dfa6 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:13.787181 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-90d9240d-3990-4e5c-ae2e-4af56480dfa6 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 83f672fe-d699-4f70-bc26-74dced714a5d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:13.793900 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-90d9240d-3990-4e5c-ae2e-4af56480dfa6 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:13.794350 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-90d9240d-3990-4e5c-ae2e-4af56480dfa6 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:13.795122 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-90d9240d-3990-4e5c-ae2e-4af56480dfa6 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:13.795560 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-90d9240d-3990-4e5c-ae2e-4af56480dfa6 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:13.939985 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-90d9240d-3990-4e5c-ae2e-4af56480dfa6 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:13.947817 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-90d9240d-3990-4e5c-ae2e-4af56480dfa6 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d" status: 200 len: 1691 microversion: 2.1 time: 0.165259 May 30 12:09:13.948439 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 341/667] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:09:13 2022] GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d => generated 1691 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:09:14.965053 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-019d9d3d-200e-4540-bb6e-30f66b0e0c9f tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:14.966135 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-019d9d3d-200e-4540-bb6e-30f66b0e0c9f tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 83f672fe-d699-4f70-bc26-74dced714a5d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:14.968377 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_api:SELECT=60,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:09:14.974378 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-019d9d3d-200e-4540-bb6e-30f66b0e0c9f tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:14.974945 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-019d9d3d-200e-4540-bb6e-30f66b0e0c9f tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:14.975786 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-019d9d3d-200e-4540-bb6e-30f66b0e0c9f tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:14.976243 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-019d9d3d-200e-4540-bb6e-30f66b0e0c9f tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:15.028890 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-27a6a638-ac7b-4704-bb1d-17b04615e019 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "POST /compute/v2.1/servers/ed036712-bf1c-4eaa-9736-b486dc1f76bf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.708768 May 30 12:09:15.029821 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 327/668] 10.222.0.32 () {60 vars in 1322 bytes} [Mon May 30 12:09:13 2022] POST /compute/v2.1/servers/ed036712-bf1c-4eaa-9736-b486dc1f76bf/os-volume_attachments => generated 194 bytes in 1711 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:09:15.137666 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-019d9d3d-200e-4540-bb6e-30f66b0e0c9f tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:15.146410 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-019d9d3d-200e-4540-bb6e-30f66b0e0c9f tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d" status: 200 len: 1691 microversion: 2.1 time: 0.185552 May 30 12:09:15.146991 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 342/669] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:09:14 2022] GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d => generated 1691 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:09:16.012747 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-391fede7-37c5-42b4-bcad-d9aa7823e402 req-a8211dd3-abd0-4a2d-8d7c-4eca3f550b2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83f672fe-d699-4f70-bc26-74dced714a5d", "name": "network-vif-deleted", "tag": "e405a0d8-23b0-474a-be51-1a5734d329c4"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:09:16.023689 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-391fede7-37c5-42b4-bcad-d9aa7823e402 req-a8211dd3-abd0-4a2d-8d7c-4eca3f550b2b service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:16.024430 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-391fede7-37c5-42b4-bcad-d9aa7823e402 req-a8211dd3-abd0-4a2d-8d7c-4eca3f550b2b service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:16.040697 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-391fede7-37c5-42b4-bcad-d9aa7823e402 req-a8211dd3-abd0-4a2d-8d7c-4eca3f550b2b service nova] Creating event network-vif-deleted:e405a0d8-23b0-474a-be51-1a5734d329c4 for instance 83f672fe-d699-4f70-bc26-74dced714a5d on hv-cinder-84051 May 30 12:09:16.046823 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-391fede7-37c5-42b4-bcad-d9aa7823e402 req-a8211dd3-abd0-4a2d-8d7c-4eca3f550b2b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038314 May 30 12:09:16.047449 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 328/670] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:09:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:09:16.163482 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-79a9b253-5bb6-46ec-b726-764c36bcd67d tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:16.164220 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-79a9b253-5bb6-46ec-b726-764c36bcd67d tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 83f672fe-d699-4f70-bc26-74dced714a5d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:16.170676 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-79a9b253-5bb6-46ec-b726-764c36bcd67d tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:16.171129 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-79a9b253-5bb6-46ec-b726-764c36bcd67d tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:16.171915 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-79a9b253-5bb6-46ec-b726-764c36bcd67d tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:16.172378 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-79a9b253-5bb6-46ec-b726-764c36bcd67d tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:16.206757 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-79a9b253-5bb6-46ec-b726-764c36bcd67d tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:16.207990 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-79a9b253-5bb6-46ec-b726-764c36bcd67d tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:16.208503 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.objects.instance [None req-79a9b253-5bb6-46ec-b726-764c36bcd67d tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lazy-loading 'fault' on Instance uuid 83f672fe-d699-4f70-bc26-74dced714a5d {{(pid=117671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 30 12:09:16.251472 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-79a9b253-5bb6-46ec-b726-764c36bcd67d tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:16.253668 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:09:16.261953 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-79a9b253-5bb6-46ec-b726-764c36bcd67d tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d" status: 200 len: 1336 microversion: 2.1 time: 0.103024 May 30 12:09:16.262543 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 343/671] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:09:16 2022] GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d => generated 1336 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:17.280118 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-b3e73152-3e47-444f-a984-ca6fb10c1210 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:17.280832 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-b3e73152-3e47-444f-a984-ca6fb10c1210 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 83f672fe-d699-4f70-bc26-74dced714a5d] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:17.287205 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b3e73152-3e47-444f-a984-ca6fb10c1210 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:17.287654 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b3e73152-3e47-444f-a984-ca6fb10c1210 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:17.288448 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b3e73152-3e47-444f-a984-ca6fb10c1210 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:17.288895 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b3e73152-3e47-444f-a984-ca6fb10c1210 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:17.302854 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.wsgi [None req-b3e73152-3e47-444f-a984-ca6fb10c1210 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] HTTP exception thrown: Instance 83f672fe-d699-4f70-bc26-74dced714a5d could not be found. May 30 12:09:17.305179 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-b3e73152-3e47-444f-a984-ca6fb10c1210 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Request method failure captured: May 30 12:09:17.305179 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: request: GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d HTTP/1.1 May 30 12:09:17.305179 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Accept: application/json May 30 12:09:17.305179 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Accept-Encoding: identity May 30 12:09:17.305179 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Connection: close May 30 12:09:17.305179 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Content-Length: 0 May 30 12:09:17.305179 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Content-Type: application/json May 30 12:09:17.305179 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Host: 10.222.0.32 May 30 12:09:17.305179 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Openstack-System-Scope: None May 30 12:09:17.305179 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: User-Agent: python-urllib3/1.26.9 May 30 12:09:17.305179 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Auth-Token: gAAAAABilLLKaQ7R80jiEHRLmMrujboD3ODo5PM_i4LfUigoNF_DSRD-7m3i96fJPk4sXF92TJEZUPTnq8UGqrdvMfAQbAX4zb4JhkZC8_4ziYoLVdZLK1Z5QiAolwIvziAlwa96-4sK6MPzDNEdNjihrFq_GGUSlYxiBpvkGIb3KNss7ddJ3EE May 30 12:09:17.305179 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Domain-Id: None May 30 12:09:17.305179 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Domain-Name: None May 30 12:09:17.305179 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Identity-Status: Confirmed May 30 12:09:17.305179 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Is-Admin-Project: True May 30 12:09:17.305179 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Domain-Id: default May 30 12:09:17.305179 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Domain-Name: Default May 30 12:09:17.305179 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Id: c988db8e79bf4c98ac288105177f90f2 May 30 12:09:17.305179 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1940623031 May 30 12:09:17.305179 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Role: reader,member May 30 12:09:17.305179 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Roles: reader,member May 30 12:09:17.306852 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/c988db8e79bf4c98ac288105177f90f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/c988db8e79bf4c98ac288105177f90f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/c988db8e79bf4c98ac288105177f90f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_c988db8e79bf4c98ac288105177f90f2", "adminURL": "http://10.222.0.32:8080"}]}] May 30 12:09:17.306852 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1940623031 May 30 12:09:17.306852 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant-Id: c988db8e79bf4c98ac288105177f90f2 May 30 12:09:17.306852 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1940623031 May 30 12:09:17.306852 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User: tempest-ServerRescueNegativeTestJSON-1940623031-project May 30 12:09:17.306852 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Domain-Id: default May 30 12:09:17.306852 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Domain-Name: Default May 30 12:09:17.306852 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Id: 166b42a5d6c04659afb20c088dfead76 May 30 12:09:17.306852 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1940623031-project May 30 12:09:17.306852 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: method: > May 30 12:09:17.306852 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: exception: Instance 83f672fe-d699-4f70-bc26-74dced714a5d could not be found. May 30 12:09:17.306852 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: action_args: {'id': '83f672fe-d699-4f70-bc26-74dced714a5d'} May 30 12:09:17.307802 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:09:17.307802 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:09:17.307802 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:09:17.307802 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:09:17.307802 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:09:17.307802 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:09:17.307802 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:09:17.307802 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:09:17.307802 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:09:17.307802 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:09:17.307802 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83f672fe-d699-4f70-bc26-74dced714a5d could not be found. May 30 12:09:17.307802 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:09:17.307802 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:09:17.307802 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:09:17.307802 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:09:17.307802 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:09:17.307802 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:09:17.307802 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:09:17.307802 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:09:17.307802 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:09:17.309349 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:09:17.309349 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 30 12:09:17.309349 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 30 12:09:17.309349 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 30 12:09:17.309349 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 30 12:09:17.309349 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:09:17.309349 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:09:17.309349 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83f672fe-d699-4f70-bc26-74dced714a5d could not be found. May 30 12:09:17.309349 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:09:17.309349 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:09:17.309349 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:09:17.309349 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:09:17.309349 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:09:17.309349 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:09:17.309349 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:09:17.309349 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:09:17.309349 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83f672fe-d699-4f70-bc26-74dced714a5d could not be found. May 30 12:09:17.309349 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:09:17.310692 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-b3e73152-3e47-444f-a984-ca6fb10c1210 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Returning 404 to user: Instance 83f672fe-d699-4f70-bc26-74dced714a5d could not be found. {{(pid=117670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:09:17.310692 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-b3e73152-3e47-444f-a984-ca6fb10c1210 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d" status: 404 len: 111 microversion: 2.1 time: 0.030688 May 30 12:09:17.310692 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 329/672] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:09:17 2022] GET /compute/v2.1/servers/83f672fe-d699-4f70-bc26-74dced714a5d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 30 12:09:17.315128 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-bf8f0c91-7678-47dc-8407-8f9e51263670 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '.version_select at 0x7f0ef88b7ee0>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:17.333708 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-bf8f0c91-7678-47dc-8407-8f9e51263670 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1845223960" status: 202 len: 0 microversion: 2.1 time: 0.022294 May 30 12:09:17.334185 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 344/673] 10.222.0.32 () {58 vars in 1220 bytes} [Mon May 30 12:09:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1845223960 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 30 12:09:20.200978 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-1231366a-518c-4d77-8bea-2b5cddea644e tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:20.201478 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-1231366a-518c-4d77-8bea-2b5cddea644e tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 8542b17d-0c65-4c5d-bc97-9d17545e2126] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:20.209121 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1231366a-518c-4d77-8bea-2b5cddea644e tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:20.209635 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1231366a-518c-4d77-8bea-2b5cddea644e tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:20.210428 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1231366a-518c-4d77-8bea-2b5cddea644e tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:20.210901 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1231366a-518c-4d77-8bea-2b5cddea644e tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:20.213974 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:09:20.238798 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-1231366a-518c-4d77-8bea-2b5cddea644e tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 8542b17d-0c65-4c5d-bc97-9d17545e2126] Going to try to terminate instance {{(pid=117670) delete /opt/stack/nova/nova/compute/api.py:2664}} May 30 12:09:20.321164 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-1231366a-518c-4d77-8bea-2b5cddea644e tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "DELETE /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126" status: 204 len: 0 microversion: 2.1 time: 0.123696 May 30 12:09:20.321783 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 330/674] 10.222.0.32 () {58 vars in 1238 bytes} [Mon May 30 12:09:20 2022] DELETE /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 30 12:09:20.332528 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-3bb76dd5-ffcc-4a39-9142-39419cb9a49e tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:20.333052 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-3bb76dd5-ffcc-4a39-9142-39419cb9a49e tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 8542b17d-0c65-4c5d-bc97-9d17545e2126] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:20.339639 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3bb76dd5-ffcc-4a39-9142-39419cb9a49e tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:20.340091 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3bb76dd5-ffcc-4a39-9142-39419cb9a49e tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:20.340901 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3bb76dd5-ffcc-4a39-9142-39419cb9a49e tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:20.341342 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3bb76dd5-ffcc-4a39-9142-39419cb9a49e tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:20.477187 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-3bb76dd5-ffcc-4a39-9142-39419cb9a49e tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:20.484859 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-3bb76dd5-ffcc-4a39-9142-39419cb9a49e tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126" status: 200 len: 1507 microversion: 2.1 time: 0.158399 May 30 12:09:20.485455 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 345/675] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:09:20 2022] GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126 => generated 1507 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:21.504036 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-b29212a6-56bd-4070-850a-bac3981102de tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:21.505158 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-b29212a6-56bd-4070-850a-bac3981102de tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 8542b17d-0c65-4c5d-bc97-9d17545e2126] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:21.512591 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b29212a6-56bd-4070-850a-bac3981102de tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:21.513052 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b29212a6-56bd-4070-850a-bac3981102de tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:21.513833 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b29212a6-56bd-4070-850a-bac3981102de tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:21.514266 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b29212a6-56bd-4070-850a-bac3981102de tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:21.675944 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-b29212a6-56bd-4070-850a-bac3981102de tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:21.684364 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-b29212a6-56bd-4070-850a-bac3981102de tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126" status: 200 len: 1507 microversion: 2.1 time: 0.185489 May 30 12:09:21.684900 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 331/676] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:09:21 2022] GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126 => generated 1507 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:22.702019 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-d0cf6af0-2488-4c15-b097-4438caa33545 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:22.702620 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-d0cf6af0-2488-4c15-b097-4438caa33545 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 8542b17d-0c65-4c5d-bc97-9d17545e2126] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:22.709239 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d0cf6af0-2488-4c15-b097-4438caa33545 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:22.709692 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d0cf6af0-2488-4c15-b097-4438caa33545 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:22.710458 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d0cf6af0-2488-4c15-b097-4438caa33545 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:22.710894 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d0cf6af0-2488-4c15-b097-4438caa33545 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:22.839444 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-d0cf6af0-2488-4c15-b097-4438caa33545 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:22.846862 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-d0cf6af0-2488-4c15-b097-4438caa33545 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126" status: 200 len: 1507 microversion: 2.1 time: 0.148721 May 30 12:09:22.847707 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 346/677] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:09:22 2022] GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126 => generated 1507 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:23.724012 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-2a163c5d-8431-45ac-bbfc-e81b4db9249b tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b92d796d-05f7-48ce-865d-f31f3e72acc0"}} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:09:23.725111 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-2a163c5d-8431-45ac-bbfc-e81b4db9249b tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: ed036712-bf1c-4eaa-9736-b486dc1f76bf] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:23.731936 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2a163c5d-8431-45ac-bbfc-e81b4db9249b tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:23.732424 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2a163c5d-8431-45ac-bbfc-e81b4db9249b tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:23.733207 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2a163c5d-8431-45ac-bbfc-e81b4db9249b tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:23.733651 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2a163c5d-8431-45ac-bbfc-e81b4db9249b tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:23.822593 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.wsgi [None req-2a163c5d-8431-45ac-bbfc-e81b4db9249b tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] HTTP exception thrown: Invalid volume: volume b92d796d-05f7-48ce-865d-f31f3e72acc0 is already attached to instances: ed036712-bf1c-4eaa-9736-b486dc1f76bf May 30 12:09:23.824808 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-2a163c5d-8431-45ac-bbfc-e81b4db9249b tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Request method failure captured: May 30 12:09:23.824808 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: request: POST /compute/v2.1/servers/ed036712-bf1c-4eaa-9736-b486dc1f76bf/os-volume_attachments HTTP/1.1 May 30 12:09:23.824808 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Accept: application/json May 30 12:09:23.824808 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Accept-Encoding: identity May 30 12:09:23.824808 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Connection: close May 30 12:09:23.824808 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Content-Length: 74 May 30 12:09:23.824808 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Content-Type: application/json May 30 12:09:23.824808 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Host: 10.222.0.32 May 30 12:09:23.824808 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Openstack-System-Scope: None May 30 12:09:23.824808 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: User-Agent: python-urllib3/1.26.9 May 30 12:09:23.824808 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Auth-Token: gAAAAABilLLAYcX6lTFc6UYhtte3qOfoT2D6p3xmrlj8lFSs8RM3SsxCJSweWMgYMCOyRE51N8YW3rSrU1JYG-ztTk5m_gEJkCNSzYatjS4LK9S2ataZ1OqgPb6zqIfN7SdtrBc2fQRHJMFEqwi_DhRkSGnSViHvbRwm6OQNgq1VdpWmApLUG3U May 30 12:09:23.824808 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Domain-Id: None May 30 12:09:23.824808 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Domain-Name: None May 30 12:09:23.824808 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Identity-Status: Confirmed May 30 12:09:23.824808 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Is-Admin-Project: True May 30 12:09:23.824808 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Domain-Id: default May 30 12:09:23.824808 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Domain-Name: Default May 30 12:09:23.824808 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Id: 20763921c37c4e81bba702e09bf628b2 May 30 12:09:23.824808 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Name: tempest-AttachVolumeNegativeTest-1368164951 May 30 12:09:23.824808 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Role: reader,member May 30 12:09:23.824808 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Roles: reader,member May 30 12:09:23.826397 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/20763921c37c4e81bba702e09bf628b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/20763921c37c4e81bba702e09bf628b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/20763921c37c4e81bba702e09bf628b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_20763921c37c4e81bba702e09bf628b2", "adminURL": "http://10.222.0.32:8080"}]}] May 30 12:09:23.826397 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant: tempest-AttachVolumeNegativeTest-1368164951 May 30 12:09:23.826397 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant-Id: 20763921c37c4e81bba702e09bf628b2 May 30 12:09:23.826397 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1368164951 May 30 12:09:23.826397 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User: tempest-AttachVolumeNegativeTest-1368164951-project May 30 12:09:23.826397 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Domain-Id: default May 30 12:09:23.826397 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Domain-Name: Default May 30 12:09:23.826397 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Id: 7575179edbda45208561c983fc5b956c May 30 12:09:23.826397 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Name: tempest-AttachVolumeNegativeTest-1368164951-project May 30 12:09:23.826397 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: May 30 12:09:23.826397 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: {"volumeAttachment": {"volumeId": "b92d796d-05f7-48ce-865d-f31f3e72acc0"}} May 30 12:09:23.826397 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: method: > May 30 12:09:23.827139 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: exception: Invalid volume: volume b92d796d-05f7-48ce-865d-f31f3e72acc0 is already attached to instances: ed036712-bf1c-4eaa-9736-b486dc1f76bf May 30 12:09:23.827139 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: action_args: {'server_id': 'ed036712-bf1c-4eaa-9736-b486dc1f76bf', 'body': {'volumeAttachment': {'volumeId': 'b92d796d-05f7-48ce-865d-f31f3e72acc0'}}} May 30 12:09:23.827139 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:09:23.827139 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:09:23.827139 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 30 12:09:23.827139 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 30 12:09:23.827139 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 30 12:09:23.827139 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 30 12:09:23.827139 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 30 12:09:23.827139 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 30 12:09:23.827139 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 30 12:09:23.827139 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 30 12:09:23.827139 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 30 12:09:23.827139 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 30 12:09:23.827139 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b92d796d-05f7-48ce-865d-f31f3e72acc0 is already attached to instances: ed036712-bf1c-4eaa-9736-b486dc1f76bf May 30 12:09:23.827139 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:09:23.827139 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:09:23.827139 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:09:23.827139 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:09:23.828381 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:09:23.828381 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:09:23.828381 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:09:23.828381 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:09:23.828381 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:09:23.828381 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:09:23.828381 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 30 12:09:23.828381 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 30 12:09:23.828381 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 30 12:09:23.828381 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 30 12:09:23.828381 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 30 12:09:23.828381 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 30 12:09:23.828381 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 30 12:09:23.828381 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 30 12:09:23.828381 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b92d796d-05f7-48ce-865d-f31f3e72acc0 is already attached to instances: ed036712-bf1c-4eaa-9736-b486dc1f76bf May 30 12:09:23.828381 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:09:23.828381 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:09:23.828381 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:09:23.828381 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:09:23.828381 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:09:23.829583 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:09:23.829583 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:09:23.829583 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:09:23.829583 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b92d796d-05f7-48ce-865d-f31f3e72acc0 is already attached to instances: ed036712-bf1c-4eaa-9736-b486dc1f76bf May 30 12:09:23.829583 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:09:23.829583 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-2a163c5d-8431-45ac-bbfc-e81b4db9249b tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Returning 400 to user: Invalid volume: volume b92d796d-05f7-48ce-865d-f31f3e72acc0 is already attached to instances: ed036712-bf1c-4eaa-9736-b486dc1f76bf {{(pid=117670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:09:23.829583 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-2a163c5d-8431-45ac-bbfc-e81b4db9249b tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "POST /compute/v2.1/servers/ed036712-bf1c-4eaa-9736-b486dc1f76bf/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.106416 May 30 12:09:23.832035 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 332/678] 10.222.0.32 () {60 vars in 1322 bytes} [Mon May 30 12:09:23 2022] POST /compute/v2.1/servers/ed036712-bf1c-4eaa-9736-b486dc1f76bf/os-volume_attachments => generated 174 bytes in 112 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 30 12:09:23.855549 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-3dc23841-fb9d-4acf-824e-b44f7cfcce6f req-cd7cc31c-43b0-4271-bc93-dda3c9516e08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8542b17d-0c65-4c5d-bc97-9d17545e2126", "name": "network-vif-deleted", "tag": "1f1b1022-04af-4f21-b1e6-4960bf03a94c"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:09:23.867529 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-9d8e3139-175c-49a8-97a5-da79bb7e7773 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:23.868787 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-9d8e3139-175c-49a8-97a5-da79bb7e7773 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 8542b17d-0c65-4c5d-bc97-9d17545e2126] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:23.876856 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9d8e3139-175c-49a8-97a5-da79bb7e7773 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:23.877095 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-3dc23841-fb9d-4acf-824e-b44f7cfcce6f req-cd7cc31c-43b0-4271-bc93-dda3c9516e08 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:23.877834 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-3dc23841-fb9d-4acf-824e-b44f7cfcce6f req-cd7cc31c-43b0-4271-bc93-dda3c9516e08 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:23.878661 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9d8e3139-175c-49a8-97a5-da79bb7e7773 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:23.880513 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9d8e3139-175c-49a8-97a5-da79bb7e7773 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:23.881115 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9d8e3139-175c-49a8-97a5-da79bb7e7773 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:23.902550 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-3dc23841-fb9d-4acf-824e-b44f7cfcce6f req-cd7cc31c-43b0-4271-bc93-dda3c9516e08 service nova] Creating event network-vif-deleted:1f1b1022-04af-4f21-b1e6-4960bf03a94c for instance 8542b17d-0c65-4c5d-bc97-9d17545e2126 on hv-cinder-84051 May 30 12:09:23.914875 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-3dc23841-fb9d-4acf-824e-b44f7cfcce6f req-cd7cc31c-43b0-4271-bc93-dda3c9516e08 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064224 May 30 12:09:23.916509 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 347/679] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:09:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:09:23.941884 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-72e074d0-1e57-462a-a131-497a495bb151 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:23.942862 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-72e074d0-1e57-462a-a131-497a495bb151 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: ed036712-bf1c-4eaa-9736-b486dc1f76bf] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:23.950101 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-72e074d0-1e57-462a-a131-497a495bb151 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:23.950693 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-72e074d0-1e57-462a-a131-497a495bb151 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:23.951727 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-72e074d0-1e57-462a-a131-497a495bb151 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:23.952190 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-72e074d0-1e57-462a-a131-497a495bb151 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:23.959787 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-9d8e3139-175c-49a8-97a5-da79bb7e7773 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:23.967635 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-9d8e3139-175c-49a8-97a5-da79bb7e7773 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126" status: 200 len: 1292 microversion: 2.1 time: 0.107266 May 30 12:09:23.968231 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 333/680] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:09:23 2022] GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126 => generated 1292 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:24.040977 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.objects.instance [None req-72e074d0-1e57-462a-a131-497a495bb151 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lazy-loading 'services' on Instance uuid ed036712-bf1c-4eaa-9736-b486dc1f76bf {{(pid=117671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 30 12:09:24.113489 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-72e074d0-1e57-462a-a131-497a495bb151 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "DELETE /compute/v2.1/servers/ed036712-bf1c-4eaa-9736-b486dc1f76bf/os-volume_attachments/b92d796d-05f7-48ce-865d-f31f3e72acc0" status: 202 len: 0 microversion: 2.1 time: 0.193147 May 30 12:09:24.114081 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 348/681] 10.222.0.32 () {58 vars in 1415 bytes} [Mon May 30 12:09:23 2022] DELETE /compute/v2.1/servers/ed036712-bf1c-4eaa-9736-b486dc1f76bf/os-volume_attachments/b92d796d-05f7-48ce-865d-f31f3e72acc0 => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 30 12:09:24.123902 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-192699f9-a2c2-4c09-8e3c-b63fadaea320 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:24.124887 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-192699f9-a2c2-4c09-8e3c-b63fadaea320 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: ed036712-bf1c-4eaa-9736-b486dc1f76bf] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:24.132795 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-192699f9-a2c2-4c09-8e3c-b63fadaea320 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:24.133254 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-192699f9-a2c2-4c09-8e3c-b63fadaea320 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:24.134043 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-192699f9-a2c2-4c09-8e3c-b63fadaea320 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:24.134487 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-192699f9-a2c2-4c09-8e3c-b63fadaea320 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:24.169036 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-192699f9-a2c2-4c09-8e3c-b63fadaea320 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/ed036712-bf1c-4eaa-9736-b486dc1f76bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049157 May 30 12:09:24.169618 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 334/682] 10.222.0.32 () {58 vars in 1301 bytes} [Mon May 30 12:09:24 2022] GET /compute/v2.1/servers/ed036712-bf1c-4eaa-9736-b486dc1f76bf/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:09:24.985745 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-80fee1bd-e184-4d40-9a92-eff46650bfba tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:24.986549 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-80fee1bd-e184-4d40-9a92-eff46650bfba tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: 8542b17d-0c65-4c5d-bc97-9d17545e2126] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:24.993319 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-80fee1bd-e184-4d40-9a92-eff46650bfba tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:24.993853 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-80fee1bd-e184-4d40-9a92-eff46650bfba tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:24.994703 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-80fee1bd-e184-4d40-9a92-eff46650bfba tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:24.995238 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-80fee1bd-e184-4d40-9a92-eff46650bfba tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:25.012293 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.wsgi [None req-80fee1bd-e184-4d40-9a92-eff46650bfba tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] HTTP exception thrown: Instance 8542b17d-0c65-4c5d-bc97-9d17545e2126 could not be found. May 30 12:09:25.014308 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-80fee1bd-e184-4d40-9a92-eff46650bfba tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Request method failure captured: May 30 12:09:25.014308 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: request: GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126 HTTP/1.1 May 30 12:09:25.014308 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Accept: application/json May 30 12:09:25.014308 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Accept-Encoding: identity May 30 12:09:25.014308 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Connection: close May 30 12:09:25.014308 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Content-Length: 0 May 30 12:09:25.014308 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Content-Type: application/json May 30 12:09:25.014308 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Host: 10.222.0.32 May 30 12:09:25.014308 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Openstack-System-Scope: None May 30 12:09:25.014308 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: User-Agent: python-urllib3/1.26.9 May 30 12:09:25.014308 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Auth-Token: gAAAAABilLLKaQ7R80jiEHRLmMrujboD3ODo5PM_i4LfUigoNF_DSRD-7m3i96fJPk4sXF92TJEZUPTnq8UGqrdvMfAQbAX4zb4JhkZC8_4ziYoLVdZLK1Z5QiAolwIvziAlwa96-4sK6MPzDNEdNjihrFq_GGUSlYxiBpvkGIb3KNss7ddJ3EE May 30 12:09:25.014308 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Domain-Id: None May 30 12:09:25.014308 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Domain-Name: None May 30 12:09:25.014308 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Identity-Status: Confirmed May 30 12:09:25.014308 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Is-Admin-Project: True May 30 12:09:25.014308 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Domain-Id: default May 30 12:09:25.014308 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Domain-Name: Default May 30 12:09:25.014308 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Id: c988db8e79bf4c98ac288105177f90f2 May 30 12:09:25.014308 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1940623031 May 30 12:09:25.014308 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Role: reader,member May 30 12:09:25.014308 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Roles: reader,member May 30 12:09:25.016661 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/c988db8e79bf4c98ac288105177f90f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/c988db8e79bf4c98ac288105177f90f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/c988db8e79bf4c98ac288105177f90f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_c988db8e79bf4c98ac288105177f90f2", "adminURL": "http://10.222.0.32:8080"}]}] May 30 12:09:25.016661 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1940623031 May 30 12:09:25.016661 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Tenant-Id: c988db8e79bf4c98ac288105177f90f2 May 30 12:09:25.016661 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1940623031 May 30 12:09:25.016661 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User: tempest-ServerRescueNegativeTestJSON-1940623031-project May 30 12:09:25.016661 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Domain-Id: default May 30 12:09:25.016661 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Domain-Name: Default May 30 12:09:25.016661 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Id: 166b42a5d6c04659afb20c088dfead76 May 30 12:09:25.016661 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1940623031-project May 30 12:09:25.016661 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: method: > May 30 12:09:25.016661 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: exception: Instance 8542b17d-0c65-4c5d-bc97-9d17545e2126 could not be found. May 30 12:09:25.016661 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: action_args: {'id': '8542b17d-0c65-4c5d-bc97-9d17545e2126'} May 30 12:09:25.017503 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:09:25.017503 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:09:25.017503 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:09:25.017503 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:09:25.017503 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:09:25.017503 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:09:25.017503 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:09:25.017503 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:09:25.017503 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:09:25.017503 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:09:25.017503 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8542b17d-0c65-4c5d-bc97-9d17545e2126 could not be found. May 30 12:09:25.017503 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:09:25.017503 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:09:25.017503 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:09:25.017503 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:09:25.017503 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:09:25.017503 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:09:25.017503 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:09:25.017503 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:09:25.017503 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:09:25.019561 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:09:25.019561 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 30 12:09:25.019561 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 30 12:09:25.019561 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 30 12:09:25.019561 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 30 12:09:25.019561 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:09:25.019561 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:09:25.019561 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8542b17d-0c65-4c5d-bc97-9d17545e2126 could not be found. May 30 12:09:25.019561 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:09:25.019561 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:09:25.019561 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:09:25.019561 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:09:25.019561 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:09:25.019561 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:09:25.019561 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:09:25.019561 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:09:25.019561 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8542b17d-0c65-4c5d-bc97-9d17545e2126 could not be found. May 30 12:09:25.019561 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:09:25.020648 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-80fee1bd-e184-4d40-9a92-eff46650bfba tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Returning 404 to user: Instance 8542b17d-0c65-4c5d-bc97-9d17545e2126 could not be found. {{(pid=117671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:09:25.020648 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-80fee1bd-e184-4d40-9a92-eff46650bfba tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126" status: 404 len: 111 microversion: 2.1 time: 0.035285 May 30 12:09:25.020648 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 349/683] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:09:24 2022] GET /compute/v2.1/servers/8542b17d-0c65-4c5d-bc97-9d17545e2126 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 30 12:09:25.026489 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-cb794fb4-833d-4758-84c9-b050a3ee4c29 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:25.027124 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-cb794fb4-833d-4758-84c9-b050a3ee4c29 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: dcdae5e3-81e8-412d-9e2a-0a481c13b57b] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:25.035285 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-cb794fb4-833d-4758-84c9-b050a3ee4c29 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:25.035755 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-cb794fb4-833d-4758-84c9-b050a3ee4c29 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:25.036608 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-cb794fb4-833d-4758-84c9-b050a3ee4c29 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:25.037046 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-cb794fb4-833d-4758-84c9-b050a3ee4c29 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:25.063692 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-cb794fb4-833d-4758-84c9-b050a3ee4c29 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: dcdae5e3-81e8-412d-9e2a-0a481c13b57b] Going to try to terminate instance {{(pid=117670) delete /opt/stack/nova/nova/compute/api.py:2664}} May 30 12:09:25.124655 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=2 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:09:25.142935 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-cb794fb4-833d-4758-84c9-b050a3ee4c29 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "DELETE /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b" status: 204 len: 0 microversion: 2.1 time: 0.120381 May 30 12:09:25.147222 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 335/684] 10.222.0.32 () {58 vars in 1238 bytes} [Mon May 30 12:09:25 2022] DELETE /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 30 12:09:25.152310 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-17517822-2143-4e92-b17c-cad809470d62 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:25.152930 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-17517822-2143-4e92-b17c-cad809470d62 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: dcdae5e3-81e8-412d-9e2a-0a481c13b57b] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:25.159246 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-17517822-2143-4e92-b17c-cad809470d62 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:25.159771 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-17517822-2143-4e92-b17c-cad809470d62 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:25.160713 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-17517822-2143-4e92-b17c-cad809470d62 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:25.161161 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-17517822-2143-4e92-b17c-cad809470d62 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:25.181515 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-9ccb5e45-a7dd-4c84-9117-8e25ccfaed40 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:25.182534 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-9ccb5e45-a7dd-4c84-9117-8e25ccfaed40 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: ed036712-bf1c-4eaa-9736-b486dc1f76bf] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:25.188768 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9ccb5e45-a7dd-4c84-9117-8e25ccfaed40 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:25.189209 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9ccb5e45-a7dd-4c84-9117-8e25ccfaed40 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:25.190012 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9ccb5e45-a7dd-4c84-9117-8e25ccfaed40 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:25.190445 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9ccb5e45-a7dd-4c84-9117-8e25ccfaed40 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:25.222791 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-9ccb5e45-a7dd-4c84-9117-8e25ccfaed40 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/ed036712-bf1c-4eaa-9736-b486dc1f76bf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045191 May 30 12:09:25.223400 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 336/685] 10.222.0.32 () {58 vars in 1301 bytes} [Mon May 30 12:09:25 2022] GET /compute/v2.1/servers/ed036712-bf1c-4eaa-9736-b486dc1f76bf/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 30 12:09:25.283635 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-8e83f29c-2a94-498f-9031-f2da0ddfc37c tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:25.284234 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-8e83f29c-2a94-498f-9031-f2da0ddfc37c tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: ed036712-bf1c-4eaa-9736-b486dc1f76bf] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:25.290415 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8e83f29c-2a94-498f-9031-f2da0ddfc37c tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:25.290944 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8e83f29c-2a94-498f-9031-f2da0ddfc37c tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:25.291845 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8e83f29c-2a94-498f-9031-f2da0ddfc37c tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:25.292320 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8e83f29c-2a94-498f-9031-f2da0ddfc37c tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:25.296822 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-17517822-2143-4e92-b17c-cad809470d62 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:25.304949 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-17517822-2143-4e92-b17c-cad809470d62 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b" status: 200 len: 1522 microversion: 2.1 time: 0.156418 May 30 12:09:25.305528 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 350/686] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:09:25 2022] GET /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:25.318290 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-8e83f29c-2a94-498f-9031-f2da0ddfc37c tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: ed036712-bf1c-4eaa-9736-b486dc1f76bf] Going to try to terminate instance {{(pid=117670) delete /opt/stack/nova/nova/compute/api.py:2664}} May 30 12:09:25.392679 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-8e83f29c-2a94-498f-9031-f2da0ddfc37c tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "DELETE /compute/v2.1/servers/ed036712-bf1c-4eaa-9736-b486dc1f76bf" status: 204 len: 0 microversion: 2.1 time: 0.112588 May 30 12:09:25.393325 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 337/687] 10.222.0.32 () {58 vars in 1238 bytes} [Mon May 30 12:09:25 2022] DELETE /compute/v2.1/servers/ed036712-bf1c-4eaa-9736-b486dc1f76bf => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 30 12:09:25.402578 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-f3a1dfb0-ed0e-4575-969d-0db4b9b7f2f5 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:25.403197 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-f3a1dfb0-ed0e-4575-969d-0db4b9b7f2f5 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: ed036712-bf1c-4eaa-9736-b486dc1f76bf] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:25.409378 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f3a1dfb0-ed0e-4575-969d-0db4b9b7f2f5 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:25.410084 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f3a1dfb0-ed0e-4575-969d-0db4b9b7f2f5 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:25.410862 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f3a1dfb0-ed0e-4575-969d-0db4b9b7f2f5 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:25.411301 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f3a1dfb0-ed0e-4575-969d-0db4b9b7f2f5 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:25.541220 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-f3a1dfb0-ed0e-4575-969d-0db4b9b7f2f5 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7575179edbda45208561c983fc5b956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20763921c37c4e81bba702e09bf628b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:25.548704 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-f3a1dfb0-ed0e-4575-969d-0db4b9b7f2f5 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/ed036712-bf1c-4eaa-9736-b486dc1f76bf" status: 200 len: 1682 microversion: 2.1 time: 0.149922 May 30 12:09:25.549264 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 351/688] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:09:25 2022] GET /compute/v2.1/servers/ed036712-bf1c-4eaa-9736-b486dc1f76bf => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:26.322029 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-76bfdd0f-7f53-4030-9231-f9663ccb0d54 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:26.323385 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-76bfdd0f-7f53-4030-9231-f9663ccb0d54 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: dcdae5e3-81e8-412d-9e2a-0a481c13b57b] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:26.330132 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-76bfdd0f-7f53-4030-9231-f9663ccb0d54 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:26.330583 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-76bfdd0f-7f53-4030-9231-f9663ccb0d54 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:26.331868 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-76bfdd0f-7f53-4030-9231-f9663ccb0d54 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:26.332360 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-76bfdd0f-7f53-4030-9231-f9663ccb0d54 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:26.468058 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-76bfdd0f-7f53-4030-9231-f9663ccb0d54 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:26.477863 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-76bfdd0f-7f53-4030-9231-f9663ccb0d54 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b" status: 200 len: 1522 microversion: 2.1 time: 0.160130 May 30 12:09:26.478636 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 338/689] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:09:26 2022] GET /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:26.566900 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-e0d11615-f6f7-4109-8ace-59402f8ea115 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:26.567513 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-e0d11615-f6f7-4109-8ace-59402f8ea115 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: ed036712-bf1c-4eaa-9736-b486dc1f76bf] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:26.574248 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e0d11615-f6f7-4109-8ace-59402f8ea115 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:26.574703 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e0d11615-f6f7-4109-8ace-59402f8ea115 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:26.575474 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e0d11615-f6f7-4109-8ace-59402f8ea115 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:26.575907 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e0d11615-f6f7-4109-8ace-59402f8ea115 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:26.704441 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-e0d11615-f6f7-4109-8ace-59402f8ea115 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7575179edbda45208561c983fc5b956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20763921c37c4e81bba702e09bf628b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:26.712512 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-e0d11615-f6f7-4109-8ace-59402f8ea115 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/ed036712-bf1c-4eaa-9736-b486dc1f76bf" status: 200 len: 1682 microversion: 2.1 time: 0.149617 May 30 12:09:26.713080 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 352/690] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:09:26 2022] GET /compute/v2.1/servers/ed036712-bf1c-4eaa-9736-b486dc1f76bf => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:27.595834 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-211d3097-dfe4-42dc-928b-b2eb281419b7 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:27.596473 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-211d3097-dfe4-42dc-928b-b2eb281419b7 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: dcdae5e3-81e8-412d-9e2a-0a481c13b57b] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:27.603116 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-211d3097-dfe4-42dc-928b-b2eb281419b7 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:27.603561 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-211d3097-dfe4-42dc-928b-b2eb281419b7 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:27.604357 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-211d3097-dfe4-42dc-928b-b2eb281419b7 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:27.604794 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-211d3097-dfe4-42dc-928b-b2eb281419b7 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:27.729369 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-9c745701-ada4-4f0c-862c-50166bdbc508 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:27.729987 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-9c745701-ada4-4f0c-862c-50166bdbc508 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: ed036712-bf1c-4eaa-9736-b486dc1f76bf] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:27.736517 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9c745701-ada4-4f0c-862c-50166bdbc508 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:27.736970 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9c745701-ada4-4f0c-862c-50166bdbc508 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:27.738525 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9c745701-ada4-4f0c-862c-50166bdbc508 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:27.739007 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9c745701-ada4-4f0c-862c-50166bdbc508 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:27.739124 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-211d3097-dfe4-42dc-928b-b2eb281419b7 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:27.747083 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-211d3097-dfe4-42dc-928b-b2eb281419b7 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b" status: 200 len: 1522 microversion: 2.1 time: 0.256017 May 30 12:09:27.756292 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 339/691] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:09:27 2022] GET /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b => generated 1522 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:27.867322 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-9c745701-ada4-4f0c-862c-50166bdbc508 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7575179edbda45208561c983fc5b956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20763921c37c4e81bba702e09bf628b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:27.874825 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-9c745701-ada4-4f0c-862c-50166bdbc508 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/ed036712-bf1c-4eaa-9736-b486dc1f76bf" status: 200 len: 1682 microversion: 2.1 time: 0.149266 May 30 12:09:27.875389 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 353/692] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:09:27 2022] GET /compute/v2.1/servers/ed036712-bf1c-4eaa-9736-b486dc1f76bf => generated 1682 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:09:28.763985 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-200d6618-4207-417e-b6d0-d94919ffd4c7 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:28.764626 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-200d6618-4207-417e-b6d0-d94919ffd4c7 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: dcdae5e3-81e8-412d-9e2a-0a481c13b57b] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:28.771771 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-200d6618-4207-417e-b6d0-d94919ffd4c7 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:28.772241 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-200d6618-4207-417e-b6d0-d94919ffd4c7 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:28.773005 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-200d6618-4207-417e-b6d0-d94919ffd4c7 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:28.773435 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-200d6618-4207-417e-b6d0-d94919ffd4c7 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:28.892285 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-87c4dcca-0c10-4936-ab6e-fe8fe473d96c tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:28.892883 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-87c4dcca-0c10-4936-ab6e-fe8fe473d96c tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: ed036712-bf1c-4eaa-9736-b486dc1f76bf] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:28.899773 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-87c4dcca-0c10-4936-ab6e-fe8fe473d96c tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:28.900256 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-87c4dcca-0c10-4936-ab6e-fe8fe473d96c tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:28.901039 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-87c4dcca-0c10-4936-ab6e-fe8fe473d96c tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:28.901476 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-87c4dcca-0c10-4936-ab6e-fe8fe473d96c tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:28.918875 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-200d6618-4207-417e-b6d0-d94919ffd4c7 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:28.926975 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-200d6618-4207-417e-b6d0-d94919ffd4c7 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b" status: 200 len: 1522 microversion: 2.1 time: 0.166848 May 30 12:09:28.927553 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 340/693] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:09:28 2022] GET /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:29.031080 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-87c4dcca-0c10-4936-ab6e-fe8fe473d96c tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7575179edbda45208561c983fc5b956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20763921c37c4e81bba702e09bf628b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:29.039550 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-87c4dcca-0c10-4936-ab6e-fe8fe473d96c tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/ed036712-bf1c-4eaa-9736-b486dc1f76bf" status: 200 len: 1682 microversion: 2.1 time: 0.151116 May 30 12:09:29.040180 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 354/694] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:09:28 2022] GET /compute/v2.1/servers/ed036712-bf1c-4eaa-9736-b486dc1f76bf => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:09:29.943423 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-4bb9751d-d49b-4203-9d51-e94bfb741969 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:29.943966 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-4bb9751d-d49b-4203-9d51-e94bfb741969 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: dcdae5e3-81e8-412d-9e2a-0a481c13b57b] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:29.950486 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4bb9751d-d49b-4203-9d51-e94bfb741969 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:29.950937 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4bb9751d-d49b-4203-9d51-e94bfb741969 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:29.951703 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4bb9751d-d49b-4203-9d51-e94bfb741969 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:29.952137 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4bb9751d-d49b-4203-9d51-e94bfb741969 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:30.057377 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-1a7267fc-45e3-4c7d-986c-35ba068e9733 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:30.057998 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-1a7267fc-45e3-4c7d-986c-35ba068e9733 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: ed036712-bf1c-4eaa-9736-b486dc1f76bf] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:30.064723 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1a7267fc-45e3-4c7d-986c-35ba068e9733 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:30.065181 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1a7267fc-45e3-4c7d-986c-35ba068e9733 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:30.066660 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1a7267fc-45e3-4c7d-986c-35ba068e9733 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:30.067108 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1a7267fc-45e3-4c7d-986c-35ba068e9733 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:30.088947 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-4bb9751d-d49b-4203-9d51-e94bfb741969 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:30.091097 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:09:30.099474 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-4bb9751d-d49b-4203-9d51-e94bfb741969 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b" status: 200 len: 1522 microversion: 2.1 time: 0.160476 May 30 12:09:30.100061 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 341/695] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:09:29 2022] GET /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:30.212655 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-1a7267fc-45e3-4c7d-986c-35ba068e9733 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7575179edbda45208561c983fc5b956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20763921c37c4e81bba702e09bf628b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:30.220512 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-1a7267fc-45e3-4c7d-986c-35ba068e9733 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/ed036712-bf1c-4eaa-9736-b486dc1f76bf" status: 200 len: 1682 microversion: 2.1 time: 0.166907 May 30 12:09:30.221127 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 355/696] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:09:30 2022] GET /compute/v2.1/servers/ed036712-bf1c-4eaa-9736-b486dc1f76bf => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:09:30.880709 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-ac34bdea-30e9-42d4-ba12-5d0cc4383aa2 req-8167a300-6061-486d-a0d6-f0108df98d4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcdae5e3-81e8-412d-9e2a-0a481c13b57b", "name": "network-vif-deleted", "tag": "4002c1fa-42e8-4916-ae13-112447234689"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:09:30.891254 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-ac34bdea-30e9-42d4-ba12-5d0cc4383aa2 req-8167a300-6061-486d-a0d6-f0108df98d4c service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:30.891897 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-ac34bdea-30e9-42d4-ba12-5d0cc4383aa2 req-8167a300-6061-486d-a0d6-f0108df98d4c service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:30.905051 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-ac34bdea-30e9-42d4-ba12-5d0cc4383aa2 req-8167a300-6061-486d-a0d6-f0108df98d4c service nova] Creating event network-vif-deleted:4002c1fa-42e8-4916-ae13-112447234689 for instance dcdae5e3-81e8-412d-9e2a-0a481c13b57b on hv-cinder-84051 May 30 12:09:30.910832 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-ac34bdea-30e9-42d4-ba12-5d0cc4383aa2 req-8167a300-6061-486d-a0d6-f0108df98d4c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035253 May 30 12:09:30.911567 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 342/697] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:09:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 30 12:09:31.116434 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-a3ce2e78-9149-4f36-96e1-b5d4a3bcbb60 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:31.117058 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-a3ce2e78-9149-4f36-96e1-b5d4a3bcbb60 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: dcdae5e3-81e8-412d-9e2a-0a481c13b57b] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:31.123920 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a3ce2e78-9149-4f36-96e1-b5d4a3bcbb60 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:31.124408 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a3ce2e78-9149-4f36-96e1-b5d4a3bcbb60 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:31.125182 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a3ce2e78-9149-4f36-96e1-b5d4a3bcbb60 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:31.125624 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a3ce2e78-9149-4f36-96e1-b5d4a3bcbb60 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:31.164193 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a3ce2e78-9149-4f36-96e1-b5d4a3bcbb60 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:31.164653 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a3ce2e78-9149-4f36-96e1-b5d4a3bcbb60 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:31.165126 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.objects.instance [None req-a3ce2e78-9149-4f36-96e1-b5d4a3bcbb60 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lazy-loading 'fault' on Instance uuid dcdae5e3-81e8-412d-9e2a-0a481c13b57b {{(pid=117671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 30 12:09:31.211129 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-a3ce2e78-9149-4f36-96e1-b5d4a3bcbb60 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166b42a5d6c04659afb20c088dfead76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c988db8e79bf4c98ac288105177f90f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:31.221450 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-a3ce2e78-9149-4f36-96e1-b5d4a3bcbb60 tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b" status: 200 len: 1312 microversion: 2.1 time: 0.108848 May 30 12:09:31.228058 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 356/698] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:09:31 2022] GET /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b => generated 1312 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:31.238955 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-37cac353-f993-43e4-8615-590922279f09 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:31.239687 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-37cac353-f993-43e4-8615-590922279f09 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: ed036712-bf1c-4eaa-9736-b486dc1f76bf] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:31.246609 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-37cac353-f993-43e4-8615-590922279f09 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:31.247054 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-37cac353-f993-43e4-8615-590922279f09 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:31.247840 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-37cac353-f993-43e4-8615-590922279f09 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:31.248308 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-37cac353-f993-43e4-8615-590922279f09 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:31.351909 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-37cac353-f993-43e4-8615-590922279f09 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7575179edbda45208561c983fc5b956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20763921c37c4e81bba702e09bf628b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:31.365003 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-37cac353-f993-43e4-8615-590922279f09 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/ed036712-bf1c-4eaa-9736-b486dc1f76bf" status: 200 len: 1615 microversion: 2.1 time: 0.130980 May 30 12:09:31.370246 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 343/699] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:09:31 2022] GET /compute/v2.1/servers/ed036712-bf1c-4eaa-9736-b486dc1f76bf => generated 1615 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:32.239472 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-dcc64e6e-ade2-4875-a5b5-a01b7165801c tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:32.240100 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-dcc64e6e-ade2-4875-a5b5-a01b7165801c tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] [instance: dcdae5e3-81e8-412d-9e2a-0a481c13b57b] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:32.247474 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-dcc64e6e-ade2-4875-a5b5-a01b7165801c tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:32.247960 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-dcc64e6e-ade2-4875-a5b5-a01b7165801c tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:32.248797 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-dcc64e6e-ade2-4875-a5b5-a01b7165801c tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:32.249282 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-dcc64e6e-ade2-4875-a5b5-a01b7165801c tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:32.264204 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.wsgi [None req-dcc64e6e-ade2-4875-a5b5-a01b7165801c tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] HTTP exception thrown: Instance dcdae5e3-81e8-412d-9e2a-0a481c13b57b could not be found. May 30 12:09:32.266018 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-dcc64e6e-ade2-4875-a5b5-a01b7165801c tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Request method failure captured: May 30 12:09:32.266018 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: request: GET /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b HTTP/1.1 May 30 12:09:32.266018 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Accept: application/json May 30 12:09:32.266018 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Accept-Encoding: identity May 30 12:09:32.266018 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Connection: close May 30 12:09:32.266018 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Content-Length: 0 May 30 12:09:32.266018 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Content-Type: application/json May 30 12:09:32.266018 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Host: 10.222.0.32 May 30 12:09:32.266018 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Openstack-System-Scope: None May 30 12:09:32.266018 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: User-Agent: python-urllib3/1.26.9 May 30 12:09:32.266018 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Auth-Token: gAAAAABilLLKaQ7R80jiEHRLmMrujboD3ODo5PM_i4LfUigoNF_DSRD-7m3i96fJPk4sXF92TJEZUPTnq8UGqrdvMfAQbAX4zb4JhkZC8_4ziYoLVdZLK1Z5QiAolwIvziAlwa96-4sK6MPzDNEdNjihrFq_GGUSlYxiBpvkGIb3KNss7ddJ3EE May 30 12:09:32.266018 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Domain-Id: None May 30 12:09:32.266018 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Domain-Name: None May 30 12:09:32.266018 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Identity-Status: Confirmed May 30 12:09:32.266018 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Is-Admin-Project: True May 30 12:09:32.266018 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Domain-Id: default May 30 12:09:32.266018 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Domain-Name: Default May 30 12:09:32.266018 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Id: c988db8e79bf4c98ac288105177f90f2 May 30 12:09:32.266018 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1940623031 May 30 12:09:32.266018 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Role: reader,member May 30 12:09:32.266018 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Roles: reader,member May 30 12:09:32.267581 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/c988db8e79bf4c98ac288105177f90f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/c988db8e79bf4c98ac288105177f90f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/c988db8e79bf4c98ac288105177f90f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_c988db8e79bf4c98ac288105177f90f2", "adminURL": "http://10.222.0.32:8080"}]}] May 30 12:09:32.267581 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1940623031 May 30 12:09:32.267581 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Tenant-Id: c988db8e79bf4c98ac288105177f90f2 May 30 12:09:32.267581 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1940623031 May 30 12:09:32.267581 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User: tempest-ServerRescueNegativeTestJSON-1940623031-project May 30 12:09:32.267581 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Domain-Id: default May 30 12:09:32.267581 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Domain-Name: Default May 30 12:09:32.267581 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Id: 166b42a5d6c04659afb20c088dfead76 May 30 12:09:32.267581 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1940623031-project May 30 12:09:32.267581 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: method: > May 30 12:09:32.267581 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: exception: Instance dcdae5e3-81e8-412d-9e2a-0a481c13b57b could not be found. May 30 12:09:32.267581 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: action_args: {'id': 'dcdae5e3-81e8-412d-9e2a-0a481c13b57b'} May 30 12:09:32.271262 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:09:32.271262 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:09:32.271262 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:09:32.271262 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:09:32.271262 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:09:32.271262 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:09:32.271262 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:09:32.271262 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:09:32.271262 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:09:32.271262 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:09:32.271262 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcdae5e3-81e8-412d-9e2a-0a481c13b57b could not be found. May 30 12:09:32.271262 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:09:32.271262 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:09:32.271262 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:09:32.271262 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:09:32.271262 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:09:32.271262 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:09:32.271262 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:09:32.271262 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:09:32.271262 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:09:32.272817 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:09:32.272817 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 30 12:09:32.272817 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 30 12:09:32.272817 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 30 12:09:32.272817 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 30 12:09:32.272817 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:09:32.272817 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:09:32.272817 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcdae5e3-81e8-412d-9e2a-0a481c13b57b could not be found. May 30 12:09:32.272817 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:09:32.272817 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:09:32.272817 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:09:32.272817 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:09:32.272817 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:09:32.272817 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:09:32.272817 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:09:32.272817 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:09:32.272817 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcdae5e3-81e8-412d-9e2a-0a481c13b57b could not be found. May 30 12:09:32.272817 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:09:32.274539 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-dcc64e6e-ade2-4875-a5b5-a01b7165801c tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] Returning 404 to user: Instance dcdae5e3-81e8-412d-9e2a-0a481c13b57b could not be found. {{(pid=117671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:09:32.274539 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-dcc64e6e-ade2-4875-a5b5-a01b7165801c tempest-ServerRescueNegativeTestJSON-1940623031 tempest-ServerRescueNegativeTestJSON-1940623031-project] 10.222.0.32 "GET /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b" status: 404 len: 111 microversion: 2.1 time: 0.032571 May 30 12:09:32.274539 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 357/700] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:09:32 2022] GET /compute/v2.1/servers/dcdae5e3-81e8-412d-9e2a-0a481c13b57b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 30 12:09:32.390287 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-12925051-69d2-4697-a491-91d5c2ee66f0 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:32.390907 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-12925051-69d2-4697-a491-91d5c2ee66f0 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: ed036712-bf1c-4eaa-9736-b486dc1f76bf] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:32.398864 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-12925051-69d2-4697-a491-91d5c2ee66f0 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:32.399343 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-12925051-69d2-4697-a491-91d5c2ee66f0 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:32.400169 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-12925051-69d2-4697-a491-91d5c2ee66f0 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:32.400629 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-12925051-69d2-4697-a491-91d5c2ee66f0 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:32.415971 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.wsgi [None req-12925051-69d2-4697-a491-91d5c2ee66f0 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] HTTP exception thrown: Instance ed036712-bf1c-4eaa-9736-b486dc1f76bf could not be found. May 30 12:09:32.417670 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-12925051-69d2-4697-a491-91d5c2ee66f0 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Request method failure captured: May 30 12:09:32.417670 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: request: GET /compute/v2.1/servers/ed036712-bf1c-4eaa-9736-b486dc1f76bf HTTP/1.1 May 30 12:09:32.417670 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Accept: application/json May 30 12:09:32.417670 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Accept-Encoding: identity May 30 12:09:32.417670 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Connection: close May 30 12:09:32.417670 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Content-Length: 0 May 30 12:09:32.417670 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Content-Type: application/json May 30 12:09:32.417670 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Host: 10.222.0.32 May 30 12:09:32.417670 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Openstack-System-Scope: None May 30 12:09:32.417670 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: User-Agent: python-urllib3/1.26.9 May 30 12:09:32.417670 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Auth-Token: gAAAAABilLLAYcX6lTFc6UYhtte3qOfoT2D6p3xmrlj8lFSs8RM3SsxCJSweWMgYMCOyRE51N8YW3rSrU1JYG-ztTk5m_gEJkCNSzYatjS4LK9S2ataZ1OqgPb6zqIfN7SdtrBc2fQRHJMFEqwi_DhRkSGnSViHvbRwm6OQNgq1VdpWmApLUG3U May 30 12:09:32.417670 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Domain-Id: None May 30 12:09:32.417670 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Domain-Name: None May 30 12:09:32.417670 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Identity-Status: Confirmed May 30 12:09:32.417670 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Is-Admin-Project: True May 30 12:09:32.417670 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Domain-Id: default May 30 12:09:32.417670 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Domain-Name: Default May 30 12:09:32.417670 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Id: 20763921c37c4e81bba702e09bf628b2 May 30 12:09:32.417670 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Name: tempest-AttachVolumeNegativeTest-1368164951 May 30 12:09:32.417670 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Role: reader,member May 30 12:09:32.417670 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Roles: reader,member May 30 12:09:32.418943 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/20763921c37c4e81bba702e09bf628b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/20763921c37c4e81bba702e09bf628b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/20763921c37c4e81bba702e09bf628b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_20763921c37c4e81bba702e09bf628b2", "adminURL": "http://10.222.0.32:8080"}]}] May 30 12:09:32.418943 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant: tempest-AttachVolumeNegativeTest-1368164951 May 30 12:09:32.418943 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant-Id: 20763921c37c4e81bba702e09bf628b2 May 30 12:09:32.418943 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1368164951 May 30 12:09:32.418943 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User: tempest-AttachVolumeNegativeTest-1368164951-project May 30 12:09:32.418943 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Domain-Id: default May 30 12:09:32.418943 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Domain-Name: Default May 30 12:09:32.418943 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Id: 7575179edbda45208561c983fc5b956c May 30 12:09:32.418943 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Name: tempest-AttachVolumeNegativeTest-1368164951-project May 30 12:09:32.418943 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: method: > May 30 12:09:32.418943 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: exception: Instance ed036712-bf1c-4eaa-9736-b486dc1f76bf could not be found. May 30 12:09:32.418943 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: action_args: {'id': 'ed036712-bf1c-4eaa-9736-b486dc1f76bf'} May 30 12:09:32.419666 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:09:32.419666 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:09:32.419666 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:09:32.419666 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:09:32.419666 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:09:32.419666 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:09:32.419666 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:09:32.419666 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:09:32.419666 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:09:32.419666 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:09:32.419666 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed036712-bf1c-4eaa-9736-b486dc1f76bf could not be found. May 30 12:09:32.419666 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:09:32.419666 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:09:32.419666 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:09:32.419666 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:09:32.419666 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:09:32.419666 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:09:32.419666 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:09:32.419666 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:09:32.419666 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:09:32.420905 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:09:32.420905 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 30 12:09:32.420905 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 30 12:09:32.420905 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 30 12:09:32.420905 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 30 12:09:32.420905 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:09:32.420905 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:09:32.420905 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed036712-bf1c-4eaa-9736-b486dc1f76bf could not be found. May 30 12:09:32.420905 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:09:32.420905 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:09:32.420905 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:09:32.420905 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:09:32.420905 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:09:32.420905 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:09:32.420905 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:09:32.420905 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:09:32.420905 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed036712-bf1c-4eaa-9736-b486dc1f76bf could not be found. May 30 12:09:32.420905 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:09:32.421980 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-12925051-69d2-4697-a491-91d5c2ee66f0 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Returning 404 to user: Instance ed036712-bf1c-4eaa-9736-b486dc1f76bf could not be found. {{(pid=117670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:09:32.421980 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-12925051-69d2-4697-a491-91d5c2ee66f0 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/ed036712-bf1c-4eaa-9736-b486dc1f76bf" status: 404 len: 111 microversion: 2.1 time: 0.032650 May 30 12:09:32.421980 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 344/701] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:09:32 2022] GET /compute/v2.1/servers/ed036712-bf1c-4eaa-9736-b486dc1f76bf => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 30 12:09:32.429043 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-6f80c332-93a3-40dd-ac46-e698b16d3d47 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '.version_select at 0x7f0ef86b9310>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:32.450386 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-6f80c332-93a3-40dd-ac46-e698b16d3d47 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1272056813" status: 202 len: 0 microversion: 2.1 time: 0.026114 May 30 12:09:32.454382 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 358/702] 10.222.0.32 () {58 vars in 1220 bytes} [Mon May 30 12:09:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1272056813 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 30 12:09:32.939597 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-690fb447-5590-40df-9f1a-847d0f066bdc req-9e0a1c5e-5e4d-4406-8947-2c6a514fe137 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed036712-bf1c-4eaa-9736-b486dc1f76bf", "name": "network-vif-deleted", "tag": "4e970db9-1999-42dc-98dc-b12c5dd44b3f"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:09:32.948280 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-690fb447-5590-40df-9f1a-847d0f066bdc req-9e0a1c5e-5e4d-4406-8947-2c6a514fe137 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:32.948731 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-690fb447-5590-40df-9f1a-847d0f066bdc req-9e0a1c5e-5e4d-4406-8947-2c6a514fe137 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:32.961201 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-690fb447-5590-40df-9f1a-847d0f066bdc req-9e0a1c5e-5e4d-4406-8947-2c6a514fe137 service nova] Creating event network-vif-deleted:4e970db9-1999-42dc-98dc-b12c5dd44b3f for instance ed036712-bf1c-4eaa-9736-b486dc1f76bf on hv-cinder-84051 May 30 12:09:32.966493 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-690fb447-5590-40df-9f1a-847d0f066bdc req-9e0a1c5e-5e4d-4406-8947-2c6a514fe137 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030524 May 30 12:09:32.967290 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 345/703] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:09:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 30 12:09:33.119354 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-80bf1ccd-b9e4-44c6-b8c4-47b7d342c225 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Action: 'create', calling method: .version_select at 0x7f0ef8782dc0>, body: {"keypair": {"name": "tempest-keypair-1202475036", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkFwlKTNciB3yve7I7jAY0yjMzxUKq5tFfKwNAOcN7qcaQ4SWii9uRnlDrCbiEUd/JJedJzpxpuM/IwxZuqxmVGg1tOVMFiZoTqawcVvsVEFTNhvQmzAeUIpu/8blJejg=="}} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:09:33.133750 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.quota [None req-80bf1ccd-b9e4-44c6-b8c4-47b7d342c225 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Getting quotas for project 20763921c37c4e81bba702e09bf628b2. Resources: {'key_pairs'} {{(pid=117671) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 30 12:09:33.137597 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.quota [None req-80bf1ccd-b9e4-44c6-b8c4-47b7d342c225 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Getting quotas for user 7575179edbda45208561c983fc5b956c and project 20763921c37c4e81bba702e09bf628b2. Resources: {'key_pairs'} {{(pid=117671) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 30 12:09:33.162643 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-80bf1ccd-b9e4-44c6-b8c4-47b7d342c225 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047074 May 30 12:09:33.163247 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 359/704] 10.222.0.32 () {60 vars in 1158 bytes} [Mon May 30 12:09:33 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:09:34.549804 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-8642d628-841f-4cd0-a97a-aef81f89ff8a tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1925972354", "imageRef": "b8ef93ed-af98-4d8c-9e1d-43d7b1f2b832", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "910909fe-c0b0-4c8d-8e4c-a23ea4b0eddd"}], "security_groups": [{"name": "tempest-securitygroup--953554509"}], "key_name": "tempest-keypair-1202475036", "user_data": "}} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:09:34.721147 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.network.neutron [None req-8642d628-841f-4cd0-a97a-aef81f89ff8a tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] validate_networks() for [('910909fe-c0b0-4c8d-8e4c-a23ea4b0eddd', None, None, None, None, None)] {{(pid=117670) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 30 12:09:35.421769 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-8642d628-841f-4cd0-a97a-aef81f89ff8a tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Flavor limits 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 30 12:09:35.422258 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-8642d628-841f-4cd0-a97a-aef81f89ff8a tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Image limits 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 30 12:09:35.422744 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-8642d628-841f-4cd0-a97a-aef81f89ff8a tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Flavor pref 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 30 12:09:35.423203 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-8642d628-841f-4cd0-a97a-aef81f89ff8a tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Image pref 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 30 12:09:35.423621 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-8642d628-841f-4cd0-a97a-aef81f89ff8a tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 30 12:09:35.433609 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8642d628-841f-4cd0-a97a-aef81f89ff8a tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:35.434063 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8642d628-841f-4cd0-a97a-aef81f89ff8a tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:35.434874 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8642d628-841f-4cd0-a97a-aef81f89ff8a tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:35.435324 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8642d628-841f-4cd0-a97a-aef81f89ff8a tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:35.453313 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.quota [None req-8642d628-841f-4cd0-a97a-aef81f89ff8a tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Getting quotas for project 20763921c37c4e81bba702e09bf628b2. Resources: {'cores', 'instances', 'ram'} {{(pid=117670) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 30 12:09:35.457682 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.quota [None req-8642d628-841f-4cd0-a97a-aef81f89ff8a tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Getting quotas for user 7575179edbda45208561c983fc5b956c and project 20763921c37c4e81bba702e09bf628b2. Resources: {'cores', 'instances', 'ram'} {{(pid=117670) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 30 12:09:35.470117 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-8642d628-841f-4cd0-a97a-aef81f89ff8a tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Going to run 1 instances... {{(pid=117670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 30 12:09:35.472641 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-8642d628-841f-4cd0-a97a-aef81f89ff8a tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: fb448f70-fb3f-4cc2-861d-941a7995e4bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b8ef93ed-af98-4d8c-9e1d-43d7b1f2b832',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 30 12:09:35.526896 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-8642d628-841f-4cd0-a97a-aef81f89ff8a tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.982361 May 30 12:09:35.528090 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 346/705] 10.222.0.32 () {60 vars in 1146 bytes} [Mon May 30 12:09:34 2022] POST /compute/v2.1/servers => generated 401 bytes in 984 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 30 12:09:35.541115 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-62580366-c73b-40c8-a064-f21f640ab927 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:35.541847 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-62580366-c73b-40c8-a064-f21f640ab927 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: fb448f70-fb3f-4cc2-861d-941a7995e4bc] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:35.622783 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-62580366-c73b-40c8-a064-f21f640ab927 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7575179edbda45208561c983fc5b956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20763921c37c4e81bba702e09bf628b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:35.631888 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-62580366-c73b-40c8-a064-f21f640ab927 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/fb448f70-fb3f-4cc2-861d-941a7995e4bc" status: 200 len: 1242 microversion: 2.1 time: 0.095678 May 30 12:09:35.633171 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 360/706] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:09:35 2022] GET /compute/v2.1/servers/fb448f70-fb3f-4cc2-861d-941a7995e4bc => generated 1242 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:36.651419 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-d74e44f9-5979-4111-a939-e41e21f723b4 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:36.652081 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-d74e44f9-5979-4111-a939-e41e21f723b4 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: fb448f70-fb3f-4cc2-861d-941a7995e4bc] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:36.659444 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d74e44f9-5979-4111-a939-e41e21f723b4 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:36.660003 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d74e44f9-5979-4111-a939-e41e21f723b4 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:36.660877 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d74e44f9-5979-4111-a939-e41e21f723b4 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:36.661404 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d74e44f9-5979-4111-a939-e41e21f723b4 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:36.729674 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-d74e44f9-5979-4111-a939-e41e21f723b4 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7575179edbda45208561c983fc5b956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20763921c37c4e81bba702e09bf628b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:36.739022 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-d74e44f9-5979-4111-a939-e41e21f723b4 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/fb448f70-fb3f-4cc2-861d-941a7995e4bc" status: 200 len: 1294 microversion: 2.1 time: 0.092163 May 30 12:09:36.740197 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 347/707] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:09:36 2022] GET /compute/v2.1/servers/fb448f70-fb3f-4cc2-861d-941a7995e4bc => generated 1294 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:37.757638 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-38342479-c224-48ec-b28e-fd1594fb4879 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:37.758257 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-38342479-c224-48ec-b28e-fd1594fb4879 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: fb448f70-fb3f-4cc2-861d-941a7995e4bc] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:37.769002 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-38342479-c224-48ec-b28e-fd1594fb4879 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:37.769465 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-38342479-c224-48ec-b28e-fd1594fb4879 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:37.770357 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-38342479-c224-48ec-b28e-fd1594fb4879 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:37.770795 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-38342479-c224-48ec-b28e-fd1594fb4879 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:37.934439 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-38342479-c224-48ec-b28e-fd1594fb4879 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7575179edbda45208561c983fc5b956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20763921c37c4e81bba702e09bf628b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:37.942525 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-38342479-c224-48ec-b28e-fd1594fb4879 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/fb448f70-fb3f-4cc2-861d-941a7995e4bc" status: 200 len: 1367 microversion: 2.1 time: 0.189703 May 30 12:09:37.943111 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 361/708] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:09:37 2022] GET /compute/v2.1/servers/fb448f70-fb3f-4cc2-861d-941a7995e4bc => generated 1367 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:38.819748 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-9967da98-92fb-4d64-b074-368fa0a8478e req-658b81f1-1319-4905-a946-1c03f921cd8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb448f70-fb3f-4cc2-861d-941a7995e4bc", "tag": "39796ecd-611c-467e-94a4-897496e879ad"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:09:38.829279 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-9967da98-92fb-4d64-b074-368fa0a8478e req-658b81f1-1319-4905-a946-1c03f921cd8a service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:38.829966 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-9967da98-92fb-4d64-b074-368fa0a8478e req-658b81f1-1319-4905-a946-1c03f921cd8a service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:38.842732 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-9967da98-92fb-4d64-b074-368fa0a8478e req-658b81f1-1319-4905-a946-1c03f921cd8a service nova] Creating event network-changed:39796ecd-611c-467e-94a4-897496e879ad for instance fb448f70-fb3f-4cc2-861d-941a7995e4bc on hv-cinder-84051 May 30 12:09:38.849159 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-9967da98-92fb-4d64-b074-368fa0a8478e req-658b81f1-1319-4905-a946-1c03f921cd8a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.184211 May 30 12:09:38.849765 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 348/709] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:09:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:09:38.959924 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-bceb1aeb-5db5-415e-9788-73d19275545d tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:38.960701 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-bceb1aeb-5db5-415e-9788-73d19275545d tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: fb448f70-fb3f-4cc2-861d-941a7995e4bc] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:38.967468 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-bceb1aeb-5db5-415e-9788-73d19275545d tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:38.968004 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-bceb1aeb-5db5-415e-9788-73d19275545d tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:38.968879 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-bceb1aeb-5db5-415e-9788-73d19275545d tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:38.969390 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-bceb1aeb-5db5-415e-9788-73d19275545d tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:39.103780 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-bceb1aeb-5db5-415e-9788-73d19275545d tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7575179edbda45208561c983fc5b956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20763921c37c4e81bba702e09bf628b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:39.111778 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-bceb1aeb-5db5-415e-9788-73d19275545d tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/fb448f70-fb3f-4cc2-861d-941a7995e4bc" status: 200 len: 1367 microversion: 2.1 time: 0.156709 May 30 12:09:39.112913 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 362/710] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:09:38 2022] GET /compute/v2.1/servers/fb448f70-fb3f-4cc2-861d-941a7995e4bc => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:40.003698 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-5bb35074-02e5-4f38-900c-caba3f8fd51a tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:40.004342 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-5bb35074-02e5-4f38-900c-caba3f8fd51a tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:40.010664 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5bb35074-02e5-4f38-900c-caba3f8fd51a tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:40.011105 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5bb35074-02e5-4f38-900c-caba3f8fd51a tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:40.012065 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5bb35074-02e5-4f38-900c-caba3f8fd51a tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:40.012545 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5bb35074-02e5-4f38-900c-caba3f8fd51a tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:40.040003 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-5bb35074-02e5-4f38-900c-caba3f8fd51a tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c/ips" status: 200 len: 151 microversion: 2.20 time: 0.200915 May 30 12:09:40.040583 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 349/711] 10.222.0.32 () {60 vars in 1288 bytes} [Mon May 30 12:09:39 2022] GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c/ips => generated 151 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 30 12:09:40.130726 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-1a90d0fc-f79c-4302-bdc2-b097b56e1a5a tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:40.131426 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-1a90d0fc-f79c-4302-bdc2-b097b56e1a5a tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: fb448f70-fb3f-4cc2-861d-941a7995e4bc] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:40.137544 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1a90d0fc-f79c-4302-bdc2-b097b56e1a5a tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:40.138087 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1a90d0fc-f79c-4302-bdc2-b097b56e1a5a tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:40.138930 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1a90d0fc-f79c-4302-bdc2-b097b56e1a5a tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:40.139435 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1a90d0fc-f79c-4302-bdc2-b097b56e1a5a tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:40.341122 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-1a90d0fc-f79c-4302-bdc2-b097b56e1a5a tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7575179edbda45208561c983fc5b956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20763921c37c4e81bba702e09bf628b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:40.361220 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-1a90d0fc-f79c-4302-bdc2-b097b56e1a5a tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/fb448f70-fb3f-4cc2-861d-941a7995e4bc" status: 200 len: 1367 microversion: 2.1 time: 0.226778 May 30 12:09:40.361965 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 363/712] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:09:40 2022] GET /compute/v2.1/servers/fb448f70-fb3f-4cc2-861d-941a7995e4bc => generated 1367 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:41.379490 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-08a2210e-c27f-4190-a27e-b1f3adf45061 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:41.380111 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-08a2210e-c27f-4190-a27e-b1f3adf45061 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: fb448f70-fb3f-4cc2-861d-941a7995e4bc] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:41.386799 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-08a2210e-c27f-4190-a27e-b1f3adf45061 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:41.387252 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-08a2210e-c27f-4190-a27e-b1f3adf45061 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:41.388024 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-08a2210e-c27f-4190-a27e-b1f3adf45061 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:41.388510 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-08a2210e-c27f-4190-a27e-b1f3adf45061 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:41.520889 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-08a2210e-c27f-4190-a27e-b1f3adf45061 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7575179edbda45208561c983fc5b956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20763921c37c4e81bba702e09bf628b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:41.528399 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-08a2210e-c27f-4190-a27e-b1f3adf45061 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/fb448f70-fb3f-4cc2-861d-941a7995e4bc" status: 200 len: 1367 microversion: 2.1 time: 0.153536 May 30 12:09:41.528962 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 350/713] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:09:41 2022] GET /compute/v2.1/servers/fb448f70-fb3f-4cc2-861d-941a7995e4bc => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:41.899390 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-bda72207-1f61-417e-968d-85da1503b68b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:09:41.899925 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-bda72207-1f61-417e-968d-85da1503b68b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:41.906501 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-bda72207-1f61-417e-968d-85da1503b68b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:41.906948 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-bda72207-1f61-417e-968d-85da1503b68b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:41.907717 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-bda72207-1f61-417e-968d-85da1503b68b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:41.908176 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-bda72207-1f61-417e-968d-85da1503b68b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:41.931140 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.objects.instance [None req-bda72207-1f61-417e-968d-85da1503b68b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lazy-loading 'flavor' on Instance uuid 0614f5df-431f-4955-acdb-05894441016c {{(pid=117671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 30 12:09:41.959117 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:09:42.198114 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-bda72207-1f61-417e-968d-85da1503b68b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "POST /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c/action" status: 202 len: 0 microversion: 2.20 time: 0.302478 May 30 12:09:42.198729 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 364/714] 10.222.0.32 () {62 vars in 1318 bytes} [Mon May 30 12:09:41 2022] POST /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c/action => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 30 12:09:42.207589 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-5cbaf551-6287-4898-a6d3-0ac198f77e80 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:42.208255 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-5cbaf551-6287-4898-a6d3-0ac198f77e80 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:42.214468 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5cbaf551-6287-4898-a6d3-0ac198f77e80 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:42.214851 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5cbaf551-6287-4898-a6d3-0ac198f77e80 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:42.215692 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5cbaf551-6287-4898-a6d3-0ac198f77e80 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:42.216313 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5cbaf551-6287-4898-a6d3-0ac198f77e80 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:42.348000 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-5cbaf551-6287-4898-a6d3-0ac198f77e80 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:42.356730 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-5cbaf551-6287-4898-a6d3-0ac198f77e80 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:42.358231 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-5cbaf551-6287-4898-a6d3-0ac198f77e80 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:42.359396 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-5cbaf551-6287-4898-a6d3-0ac198f77e80 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c" status: 200 len: 1722 microversion: 2.20 time: 0.156471 May 30 12:09:42.359957 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 351/715] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:09:42 2022] GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:09:42.481453 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-b6a962f5-3e5b-4dbb-a628-9cf50dbebf01 req-1d30e758-a25a-4e71-bf12-f30803958e3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb448f70-fb3f-4cc2-861d-941a7995e4bc", "name": "network-vif-plugged", "status": "completed", "tag": "39796ecd-611c-467e-94a4-897496e879ad"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:09:42.490968 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-b6a962f5-3e5b-4dbb-a628-9cf50dbebf01 req-1d30e758-a25a-4e71-bf12-f30803958e3a service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:42.491610 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-b6a962f5-3e5b-4dbb-a628-9cf50dbebf01 req-1d30e758-a25a-4e71-bf12-f30803958e3a service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:42.506040 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-b6a962f5-3e5b-4dbb-a628-9cf50dbebf01 req-1d30e758-a25a-4e71-bf12-f30803958e3a service nova] Creating event network-vif-plugged:39796ecd-611c-467e-94a4-897496e879ad for instance fb448f70-fb3f-4cc2-861d-941a7995e4bc on hv-cinder-84051 May 30 12:09:42.511002 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-b6a962f5-3e5b-4dbb-a628-9cf50dbebf01 req-1d30e758-a25a-4e71-bf12-f30803958e3a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033730 May 30 12:09:42.511595 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 365/716] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:09:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:09:42.545691 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-9fbb79fd-c429-4dbc-a9d7-9e4c9a876727 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:42.546526 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-9fbb79fd-c429-4dbc-a9d7-9e4c9a876727 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: fb448f70-fb3f-4cc2-861d-941a7995e4bc] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:42.555691 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9fbb79fd-c429-4dbc-a9d7-9e4c9a876727 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:42.556128 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9fbb79fd-c429-4dbc-a9d7-9e4c9a876727 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:42.556926 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9fbb79fd-c429-4dbc-a9d7-9e4c9a876727 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:42.557384 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9fbb79fd-c429-4dbc-a9d7-9e4c9a876727 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:42.691244 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-9fbb79fd-c429-4dbc-a9d7-9e4c9a876727 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7575179edbda45208561c983fc5b956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20763921c37c4e81bba702e09bf628b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:42.698801 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-9fbb79fd-c429-4dbc-a9d7-9e4c9a876727 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/fb448f70-fb3f-4cc2-861d-941a7995e4bc" status: 200 len: 1367 microversion: 2.1 time: 0.157649 May 30 12:09:42.699378 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 352/717] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:09:42 2022] GET /compute/v2.1/servers/fb448f70-fb3f-4cc2-861d-941a7995e4bc => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:43.379916 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-f41b40c8-4929-4197-9b60-5c20d3249898 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:43.380639 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-f41b40c8-4929-4197-9b60-5c20d3249898 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:43.387347 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f41b40c8-4929-4197-9b60-5c20d3249898 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:43.387786 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f41b40c8-4929-4197-9b60-5c20d3249898 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:43.388581 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f41b40c8-4929-4197-9b60-5c20d3249898 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:43.389013 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f41b40c8-4929-4197-9b60-5c20d3249898 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:43.679115 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-f41b40c8-4929-4197-9b60-5c20d3249898 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:43.687326 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-f41b40c8-4929-4197-9b60-5c20d3249898 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:43.688985 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-f41b40c8-4929-4197-9b60-5c20d3249898 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:43.690927 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-f41b40c8-4929-4197-9b60-5c20d3249898 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c" status: 200 len: 1722 microversion: 2.20 time: 0.315516 May 30 12:09:43.691614 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 366/718] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:09:43 2022] GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c => generated 1722 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:09:43.715785 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-21333a50-309a-44d9-ab11-cee4aeb0f61e tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:43.716464 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-21333a50-309a-44d9-ab11-cee4aeb0f61e tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: fb448f70-fb3f-4cc2-861d-941a7995e4bc] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:43.723190 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-21333a50-309a-44d9-ab11-cee4aeb0f61e tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:43.723690 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-21333a50-309a-44d9-ab11-cee4aeb0f61e tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:43.724487 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-21333a50-309a-44d9-ab11-cee4aeb0f61e tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:43.724922 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-21333a50-309a-44d9-ab11-cee4aeb0f61e tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:43.853796 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-21333a50-309a-44d9-ab11-cee4aeb0f61e tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7575179edbda45208561c983fc5b956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20763921c37c4e81bba702e09bf628b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:43.861283 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-21333a50-309a-44d9-ab11-cee4aeb0f61e tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/fb448f70-fb3f-4cc2-861d-941a7995e4bc" status: 200 len: 1367 microversion: 2.1 time: 0.149303 May 30 12:09:43.862355 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 353/719] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:09:43 2022] GET /compute/v2.1/servers/fb448f70-fb3f-4cc2-861d-941a7995e4bc => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:44.709871 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-4186c0c0-b89b-4d6c-8049-0496cf3a819f tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:44.711091 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-4186c0c0-b89b-4d6c-8049-0496cf3a819f tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:44.718571 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4186c0c0-b89b-4d6c-8049-0496cf3a819f tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:44.719013 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4186c0c0-b89b-4d6c-8049-0496cf3a819f tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:44.719782 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4186c0c0-b89b-4d6c-8049-0496cf3a819f tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:44.720232 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4186c0c0-b89b-4d6c-8049-0496cf3a819f tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:44.860486 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-4186c0c0-b89b-4d6c-8049-0496cf3a819f tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:44.868595 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-4186c0c0-b89b-4d6c-8049-0496cf3a819f tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:44.870115 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-4186c0c0-b89b-4d6c-8049-0496cf3a819f tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:44.871521 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-4186c0c0-b89b-4d6c-8049-0496cf3a819f tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c" status: 200 len: 1722 microversion: 2.20 time: 0.166094 May 30 12:09:44.873400 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 367/720] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:09:44 2022] GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:09:44.882736 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-444f2c88-78e4-4cec-888d-87be969de6c0 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:44.883979 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-444f2c88-78e4-4cec-888d-87be969de6c0 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: fb448f70-fb3f-4cc2-861d-941a7995e4bc] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:44.890330 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-444f2c88-78e4-4cec-888d-87be969de6c0 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:44.890788 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-444f2c88-78e4-4cec-888d-87be969de6c0 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:44.891572 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-444f2c88-78e4-4cec-888d-87be969de6c0 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:44.892008 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-444f2c88-78e4-4cec-888d-87be969de6c0 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:45.047372 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-444f2c88-78e4-4cec-888d-87be969de6c0 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7575179edbda45208561c983fc5b956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20763921c37c4e81bba702e09bf628b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:45.055886 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-444f2c88-78e4-4cec-888d-87be969de6c0 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/fb448f70-fb3f-4cc2-861d-941a7995e4bc" status: 200 len: 1367 microversion: 2.1 time: 0.181664 May 30 12:09:45.056557 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 354/721] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:09:44 2022] GET /compute/v2.1/servers/fb448f70-fb3f-4cc2-861d-941a7995e4bc => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:45.665249 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell0:SELECT=6 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:09:45.770145 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-2b8cb0d8-bcbe-45a8-aca4-9840cab19542 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:45.770145 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-2b8cb0d8-bcbe-45a8-aca4-9840cab19542 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 9c81cc0f-7430-4246-a05e-4670433f04ac] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:45.774896 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_api:SELECT=69,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:09:45.781652 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2b8cb0d8-bcbe-45a8-aca4-9840cab19542 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:45.782136 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2b8cb0d8-bcbe-45a8-aca4-9840cab19542 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:45.783175 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2b8cb0d8-bcbe-45a8-aca4-9840cab19542 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:45.784152 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2b8cb0d8-bcbe-45a8-aca4-9840cab19542 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:45.808052 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-2b8cb0d8-bcbe-45a8-aca4-9840cab19542 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/9c81cc0f-7430-4246-a05e-4670433f04ac/ips" status: 200 len: 147 microversion: 2.1 time: 0.147247 May 30 12:09:45.808636 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 368/722] 10.222.0.32 () {58 vars in 1247 bytes} [Mon May 30 12:09:45 2022] GET /compute/v2.1/servers/9c81cc0f-7430-4246-a05e-4670433f04ac/ips => generated 147 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 30 12:09:45.890972 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-b02b90aa-f4b0-44fe-b283-fcf01c4af9ed tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:45.891588 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-b02b90aa-f4b0-44fe-b283-fcf01c4af9ed tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:45.894365 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell0:SELECT=2 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:09:45.895342 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell0:SELECT=6 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:09:45.901966 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b02b90aa-f4b0-44fe-b283-fcf01c4af9ed tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:45.902420 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b02b90aa-f4b0-44fe-b283-fcf01c4af9ed tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:45.903194 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b02b90aa-f4b0-44fe-b283-fcf01c4af9ed tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:45.903723 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b02b90aa-f4b0-44fe-b283-fcf01c4af9ed tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:46.061024 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-b02b90aa-f4b0-44fe-b283-fcf01c4af9ed tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:46.073816 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-ce90c750-00fb-452d-85b6-46f7e94f38b4 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:46.074679 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-ce90c750-00fb-452d-85b6-46f7e94f38b4 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: fb448f70-fb3f-4cc2-861d-941a7995e4bc] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:46.079688 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-b02b90aa-f4b0-44fe-b283-fcf01c4af9ed tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:46.085574 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-b02b90aa-f4b0-44fe-b283-fcf01c4af9ed tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:46.086798 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-b02b90aa-f4b0-44fe-b283-fcf01c4af9ed tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c" status: 200 len: 1722 microversion: 2.20 time: 0.199811 May 30 12:09:46.087551 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 355/723] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:09:45 2022] GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c => generated 1722 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:09:46.088295 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ce90c750-00fb-452d-85b6-46f7e94f38b4 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:46.088907 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ce90c750-00fb-452d-85b6-46f7e94f38b4 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:46.089836 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ce90c750-00fb-452d-85b6-46f7e94f38b4 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:46.090402 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ce90c750-00fb-452d-85b6-46f7e94f38b4 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:46.235928 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-ce90c750-00fb-452d-85b6-46f7e94f38b4 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7575179edbda45208561c983fc5b956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20763921c37c4e81bba702e09bf628b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:46.247753 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-ce90c750-00fb-452d-85b6-46f7e94f38b4 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/fb448f70-fb3f-4cc2-861d-941a7995e4bc" status: 200 len: 1557 microversion: 2.1 time: 0.174443 May 30 12:09:46.247753 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 369/724] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:09:46 2022] GET /compute/v2.1/servers/fb448f70-fb3f-4cc2-861d-941a7995e4bc => generated 1557 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:46.261355 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-045260af-d9c6-4282-8730-97ca366c6066 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:46.262123 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-045260af-d9c6-4282-8730-97ca366c6066 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: fb448f70-fb3f-4cc2-861d-941a7995e4bc] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:46.269140 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-045260af-d9c6-4282-8730-97ca366c6066 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:46.269589 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-045260af-d9c6-4282-8730-97ca366c6066 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:46.270538 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-045260af-d9c6-4282-8730-97ca366c6066 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:46.271139 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-045260af-d9c6-4282-8730-97ca366c6066 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:46.356953 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-045260af-d9c6-4282-8730-97ca366c6066 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/fb448f70-fb3f-4cc2-861d-941a7995e4bc/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.099234 May 30 12:09:46.357589 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 356/725] 10.222.0.32 () {58 vars in 1274 bytes} [Mon May 30 12:09:46 2022] GET /compute/v2.1/servers/fb448f70-fb3f-4cc2-861d-941a7995e4bc/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:09:47.104492 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-913231a3-6e85-4cb7-b26c-6b18d0261097 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:47.105303 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-913231a3-6e85-4cb7-b26c-6b18d0261097 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:47.112859 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-913231a3-6e85-4cb7-b26c-6b18d0261097 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:47.113330 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-913231a3-6e85-4cb7-b26c-6b18d0261097 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:47.114086 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-913231a3-6e85-4cb7-b26c-6b18d0261097 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:47.114693 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-913231a3-6e85-4cb7-b26c-6b18d0261097 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:47.173563 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-ff48fb9f-2781-48a3-98b3-3f908ba71773 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1818ce5c-9fcf-4330-a039-62f00229c5c3"}} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:09:47.175833 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-ff48fb9f-2781-48a3-98b3-3f908ba71773 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 9c81cc0f-7430-4246-a05e-4670433f04ac] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:47.182164 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ff48fb9f-2781-48a3-98b3-3f908ba71773 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:47.182628 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ff48fb9f-2781-48a3-98b3-3f908ba71773 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:47.183407 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ff48fb9f-2781-48a3-98b3-3f908ba71773 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:47.184052 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ff48fb9f-2781-48a3-98b3-3f908ba71773 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:47.397520 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-913231a3-6e85-4cb7-b26c-6b18d0261097 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:47.405861 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-913231a3-6e85-4cb7-b26c-6b18d0261097 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:47.407521 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-913231a3-6e85-4cb7-b26c-6b18d0261097 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:47.409504 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-913231a3-6e85-4cb7-b26c-6b18d0261097 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c" status: 200 len: 1722 microversion: 2.20 time: 0.308965 May 30 12:09:47.410326 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 370/726] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:09:47 2022] GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c => generated 1722 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:09:47.466765 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-ff48fb9f-2781-48a3-98b3-3f908ba71773 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "POST /compute/v2.1/servers/9c81cc0f-7430-4246-a05e-4670433f04ac/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.297468 May 30 12:09:47.473113 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 357/727] 10.222.0.32 () {60 vars in 1322 bytes} [Mon May 30 12:09:47 2022] POST /compute/v2.1/servers/9c81cc0f-7430-4246-a05e-4670433f04ac/os-volume_attachments => generated 194 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 30 12:09:47.767078 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-5f17f2a5-cb19-49c7-8851-a91464b1f8aa req-ffda5270-b2f0-4f64-af79-bd9a71b5bca3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb448f70-fb3f-4cc2-861d-941a7995e4bc", "tag": "39796ecd-611c-467e-94a4-897496e879ad"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:09:47.777253 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-5f17f2a5-cb19-49c7-8851-a91464b1f8aa req-ffda5270-b2f0-4f64-af79-bd9a71b5bca3 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:47.777694 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-5f17f2a5-cb19-49c7-8851-a91464b1f8aa req-ffda5270-b2f0-4f64-af79-bd9a71b5bca3 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:47.790500 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-5f17f2a5-cb19-49c7-8851-a91464b1f8aa req-ffda5270-b2f0-4f64-af79-bd9a71b5bca3 service nova] Creating event network-changed:39796ecd-611c-467e-94a4-897496e879ad for instance fb448f70-fb3f-4cc2-861d-941a7995e4bc on hv-cinder-84051 May 30 12:09:47.795711 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-5f17f2a5-cb19-49c7-8851-a91464b1f8aa req-ffda5270-b2f0-4f64-af79-bd9a71b5bca3 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114248 May 30 12:09:47.796300 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 371/728] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:09:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:09:48.431556 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-68d74f3b-d80e-481b-9117-7c36685b4d5f tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:48.432352 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-68d74f3b-d80e-481b-9117-7c36685b4d5f tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:48.438949 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-68d74f3b-d80e-481b-9117-7c36685b4d5f tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:48.439409 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-68d74f3b-d80e-481b-9117-7c36685b4d5f tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:48.440207 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-68d74f3b-d80e-481b-9117-7c36685b4d5f tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:48.440830 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-68d74f3b-d80e-481b-9117-7c36685b4d5f tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:48.579676 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-68d74f3b-d80e-481b-9117-7c36685b4d5f tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:48.588077 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-68d74f3b-d80e-481b-9117-7c36685b4d5f tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:48.589858 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-68d74f3b-d80e-481b-9117-7c36685b4d5f tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:48.591043 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-68d74f3b-d80e-481b-9117-7c36685b4d5f tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c" status: 200 len: 1722 microversion: 2.20 time: 0.164373 May 30 12:09:48.591797 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 358/729] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:09:48 2022] GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:09:49.610552 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-ab3a2c01-f7a8-49d5-b7bb-65f87c749dff tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:49.611389 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-ab3a2c01-f7a8-49d5-b7bb-65f87c749dff tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:49.618271 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ab3a2c01-f7a8-49d5-b7bb-65f87c749dff tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:49.618715 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ab3a2c01-f7a8-49d5-b7bb-65f87c749dff tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:49.619495 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ab3a2c01-f7a8-49d5-b7bb-65f87c749dff tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:49.619927 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ab3a2c01-f7a8-49d5-b7bb-65f87c749dff tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:49.778329 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-ab3a2c01-f7a8-49d5-b7bb-65f87c749dff tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:49.786338 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-ab3a2c01-f7a8-49d5-b7bb-65f87c749dff tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:49.787830 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-ab3a2c01-f7a8-49d5-b7bb-65f87c749dff tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:49.789018 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-ab3a2c01-f7a8-49d5-b7bb-65f87c749dff tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c" status: 200 len: 1722 microversion: 2.20 time: 0.183174 May 30 12:09:49.789556 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 372/730] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:09:49 2022] GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:09:50.806929 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-07aae4e9-118d-4d4d-860c-3f587674eeca tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:50.807546 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-07aae4e9-118d-4d4d-860c-3f587674eeca tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:50.814062 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-07aae4e9-118d-4d4d-860c-3f587674eeca tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:50.815007 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-07aae4e9-118d-4d4d-860c-3f587674eeca tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:50.815774 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-07aae4e9-118d-4d4d-860c-3f587674eeca tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:50.816284 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-07aae4e9-118d-4d4d-860c-3f587674eeca tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:50.945089 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-07aae4e9-118d-4d4d-860c-3f587674eeca tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:50.953577 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-07aae4e9-118d-4d4d-860c-3f587674eeca tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:50.955707 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-07aae4e9-118d-4d4d-860c-3f587674eeca tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:50.957287 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-07aae4e9-118d-4d4d-860c-3f587674eeca tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c" status: 200 len: 1722 microversion: 2.20 time: 0.154377 May 30 12:09:50.957846 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 359/731] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:09:50 2022] GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:09:51.974888 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-0459ee54-db8c-4aa4-b686-0d3cb703301c tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:51.975453 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-0459ee54-db8c-4aa4-b686-0d3cb703301c tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:51.982844 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0459ee54-db8c-4aa4-b686-0d3cb703301c tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:51.983285 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0459ee54-db8c-4aa4-b686-0d3cb703301c tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:51.984046 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0459ee54-db8c-4aa4-b686-0d3cb703301c tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:51.984503 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0459ee54-db8c-4aa4-b686-0d3cb703301c tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:52.121827 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-0459ee54-db8c-4aa4-b686-0d3cb703301c tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:52.130926 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-0459ee54-db8c-4aa4-b686-0d3cb703301c tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:52.132466 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-0459ee54-db8c-4aa4-b686-0d3cb703301c tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:52.133639 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-0459ee54-db8c-4aa4-b686-0d3cb703301c tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c" status: 200 len: 1722 microversion: 2.20 time: 0.162964 May 30 12:09:52.134193 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 373/732] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:09:51 2022] GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:09:53.153105 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-6f23c71a-8439-47ae-8fdf-6dd5f19d922b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:53.153620 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-6f23c71a-8439-47ae-8fdf-6dd5f19d922b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:53.160679 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6f23c71a-8439-47ae-8fdf-6dd5f19d922b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:53.161131 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6f23c71a-8439-47ae-8fdf-6dd5f19d922b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:53.161900 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6f23c71a-8439-47ae-8fdf-6dd5f19d922b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:53.162369 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6f23c71a-8439-47ae-8fdf-6dd5f19d922b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:53.293057 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-6f23c71a-8439-47ae-8fdf-6dd5f19d922b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:53.301974 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-6f23c71a-8439-47ae-8fdf-6dd5f19d922b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:53.303627 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-6f23c71a-8439-47ae-8fdf-6dd5f19d922b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:53.304834 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-6f23c71a-8439-47ae-8fdf-6dd5f19d922b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c" status: 200 len: 1722 microversion: 2.20 time: 0.155759 May 30 12:09:53.305399 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 360/733] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:09:53 2022] GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:09:54.324130 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-f145b337-9057-4701-a2a3-3836255cdabe tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:54.324769 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-f145b337-9057-4701-a2a3-3836255cdabe tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:54.331850 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f145b337-9057-4701-a2a3-3836255cdabe tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:54.332394 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f145b337-9057-4701-a2a3-3836255cdabe tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:54.333172 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f145b337-9057-4701-a2a3-3836255cdabe tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:54.333612 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f145b337-9057-4701-a2a3-3836255cdabe tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:54.462598 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-f145b337-9057-4701-a2a3-3836255cdabe tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:54.470451 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-f145b337-9057-4701-a2a3-3836255cdabe tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:54.471933 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-f145b337-9057-4701-a2a3-3836255cdabe tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:54.473431 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-f145b337-9057-4701-a2a3-3836255cdabe tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c" status: 200 len: 1722 microversion: 2.20 time: 0.153249 May 30 12:09:54.473975 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 374/734] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:09:54 2022] GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:09:55.006359 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-71b771a8-59d9-47d8-8cea-c639c19fee7e tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:55.007344 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-71b771a8-59d9-47d8-8cea-c639c19fee7e tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 9c81cc0f-7430-4246-a05e-4670433f04ac] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:55.013968 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-71b771a8-59d9-47d8-8cea-c639c19fee7e tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:55.014392 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-71b771a8-59d9-47d8-8cea-c639c19fee7e tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:55.015172 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-71b771a8-59d9-47d8-8cea-c639c19fee7e tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:55.015592 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-71b771a8-59d9-47d8-8cea-c639c19fee7e tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:55.018087 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:09:55.047281 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-71b771a8-59d9-47d8-8cea-c639c19fee7e tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/9c81cc0f-7430-4246-a05e-4670433f04ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045782 May 30 12:09:55.047839 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 361/735] 10.222.0.32 () {58 vars in 1301 bytes} [Mon May 30 12:09:55 2022] GET /compute/v2.1/servers/9c81cc0f-7430-4246-a05e-4670433f04ac/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:09:55.058533 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-907d1acb-f118-4257-9a1a-60c592fcb117 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:55.059032 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-907d1acb-f118-4257-9a1a-60c592fcb117 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 9c81cc0f-7430-4246-a05e-4670433f04ac] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:55.065098 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-907d1acb-f118-4257-9a1a-60c592fcb117 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:55.065559 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-907d1acb-f118-4257-9a1a-60c592fcb117 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:55.066908 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-907d1acb-f118-4257-9a1a-60c592fcb117 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:55.067349 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-907d1acb-f118-4257-9a1a-60c592fcb117 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:55.095459 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-907d1acb-f118-4257-9a1a-60c592fcb117 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/9c81cc0f-7430-4246-a05e-4670433f04ac/os-volume_attachments/1818ce5c-9fcf-4330-a039-62f00229c5c3" status: 200 len: 194 microversion: 2.1 time: 0.040942 May 30 12:09:55.096076 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 375/736] 10.222.0.32 () {58 vars in 1412 bytes} [Mon May 30 12:09:55 2022] GET /compute/v2.1/servers/9c81cc0f-7430-4246-a05e-4670433f04ac/os-volume_attachments/1818ce5c-9fcf-4330-a039-62f00229c5c3 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:09:55.491663 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-d8e52d22-2f6f-4afe-8716-c17691fc6672 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:55.492311 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-d8e52d22-2f6f-4afe-8716-c17691fc6672 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:55.494197 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:09:55.499441 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d8e52d22-2f6f-4afe-8716-c17691fc6672 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:55.499892 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d8e52d22-2f6f-4afe-8716-c17691fc6672 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:55.500690 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d8e52d22-2f6f-4afe-8716-c17691fc6672 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:55.501129 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d8e52d22-2f6f-4afe-8716-c17691fc6672 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:55.635383 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-d8e52d22-2f6f-4afe-8716-c17691fc6672 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:55.646452 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-d8e52d22-2f6f-4afe-8716-c17691fc6672 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:55.648312 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-d8e52d22-2f6f-4afe-8716-c17691fc6672 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:55.649671 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-d8e52d22-2f6f-4afe-8716-c17691fc6672 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c" status: 200 len: 1722 microversion: 2.20 time: 0.162063 May 30 12:09:55.650378 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 362/737] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:09:55 2022] GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:09:56.428693 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-72a741c4-eb04-4283-ab4a-41c0fd312f93 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "475479e1-cbf9-4cf3-9605-581a4a425337"}} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:09:56.429761 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-72a741c4-eb04-4283-ab4a-41c0fd312f93 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 9c81cc0f-7430-4246-a05e-4670433f04ac] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:56.436335 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-72a741c4-eb04-4283-ab4a-41c0fd312f93 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:56.436786 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-72a741c4-eb04-4283-ab4a-41c0fd312f93 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:56.437563 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-72a741c4-eb04-4283-ab4a-41c0fd312f93 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:56.437999 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-72a741c4-eb04-4283-ab4a-41c0fd312f93 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:56.674324 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-32ca2854-f91d-4abf-9895-8e8b1c235052 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:56.675860 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-32ca2854-f91d-4abf-9895-8e8b1c235052 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:56.682858 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-32ca2854-f91d-4abf-9895-8e8b1c235052 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:56.683316 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-32ca2854-f91d-4abf-9895-8e8b1c235052 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:56.684072 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-32ca2854-f91d-4abf-9895-8e8b1c235052 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:56.684534 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-32ca2854-f91d-4abf-9895-8e8b1c235052 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:56.688457 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-72a741c4-eb04-4283-ab4a-41c0fd312f93 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "POST /compute/v2.1/servers/9c81cc0f-7430-4246-a05e-4670433f04ac/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.264050 May 30 12:09:56.689074 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 376/738] 10.222.0.32 () {60 vars in 1322 bytes} [Mon May 30 12:09:56 2022] POST /compute/v2.1/servers/9c81cc0f-7430-4246-a05e-4670433f04ac/os-volume_attachments => generated 194 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 30 12:09:56.835493 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-32ca2854-f91d-4abf-9895-8e8b1c235052 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:56.843579 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-32ca2854-f91d-4abf-9895-8e8b1c235052 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:56.845194 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-32ca2854-f91d-4abf-9895-8e8b1c235052 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:56.846476 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-32ca2854-f91d-4abf-9895-8e8b1c235052 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c" status: 200 len: 1722 microversion: 2.20 time: 0.176006 May 30 12:09:56.847298 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 363/739] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:09:56 2022] GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 30 12:09:57.865783 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-ed801c41-019b-4953-9842-6d23daf040cd tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:57.866465 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-ed801c41-019b-4953-9842-6d23daf040cd tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:57.873274 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ed801c41-019b-4953-9842-6d23daf040cd tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:57.873731 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ed801c41-019b-4953-9842-6d23daf040cd tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:57.874509 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ed801c41-019b-4953-9842-6d23daf040cd tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:57.874944 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ed801c41-019b-4953-9842-6d23daf040cd tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:58.007311 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-ed801c41-019b-4953-9842-6d23daf040cd tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:58.015258 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-ed801c41-019b-4953-9842-6d23daf040cd tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:58.016791 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-ed801c41-019b-4953-9842-6d23daf040cd tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:58.017941 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-ed801c41-019b-4953-9842-6d23daf040cd tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c" status: 200 len: 1722 microversion: 2.20 time: 0.156735 May 30 12:09:58.018750 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 377/740] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:09:57 2022] GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:09:59.036964 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-6a088577-a7db-474c-9959-95069463f167 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:59.037573 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-6a088577-a7db-474c-9959-95069463f167 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:59.043949 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6a088577-a7db-474c-9959-95069463f167 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:59.044426 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6a088577-a7db-474c-9959-95069463f167 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:59.045181 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6a088577-a7db-474c-9959-95069463f167 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:59.045609 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6a088577-a7db-474c-9959-95069463f167 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:59.174303 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-6a088577-a7db-474c-9959-95069463f167 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:59.183081 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-6a088577-a7db-474c-9959-95069463f167 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:59.184603 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-6a088577-a7db-474c-9959-95069463f167 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:59.185767 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-6a088577-a7db-474c-9959-95069463f167 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c" status: 200 len: 1722 microversion: 2.20 time: 0.153493 May 30 12:09:59.186320 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 364/741] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:09:59 2022] GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:10:00.203839 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-bdbedabc-af0b-4799-932a-b5c8fa87fb9f tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:00.204413 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-bdbedabc-af0b-4799-932a-b5c8fa87fb9f tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:00.211167 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-bdbedabc-af0b-4799-932a-b5c8fa87fb9f tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:00.211622 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-bdbedabc-af0b-4799-932a-b5c8fa87fb9f tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:00.212421 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-bdbedabc-af0b-4799-932a-b5c8fa87fb9f tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:00.212871 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-bdbedabc-af0b-4799-932a-b5c8fa87fb9f tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:00.342910 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-bdbedabc-af0b-4799-932a-b5c8fa87fb9f tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:00.351604 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-bdbedabc-af0b-4799-932a-b5c8fa87fb9f tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:00.353150 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-bdbedabc-af0b-4799-932a-b5c8fa87fb9f tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:00.354316 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-bdbedabc-af0b-4799-932a-b5c8fa87fb9f tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c" status: 200 len: 1722 microversion: 2.20 time: 0.154563 May 30 12:10:00.354871 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 378/742] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:10:00 2022] GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:10:01.373885 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-f33c1370-9810-417f-9105-5626a8c2b754 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:01.374541 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-f33c1370-9810-417f-9105-5626a8c2b754 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:01.383868 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f33c1370-9810-417f-9105-5626a8c2b754 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:01.384395 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f33c1370-9810-417f-9105-5626a8c2b754 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:01.385172 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f33c1370-9810-417f-9105-5626a8c2b754 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:01.385613 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f33c1370-9810-417f-9105-5626a8c2b754 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:01.516658 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-f33c1370-9810-417f-9105-5626a8c2b754 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:01.524961 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-f33c1370-9810-417f-9105-5626a8c2b754 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:01.526482 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-f33c1370-9810-417f-9105-5626a8c2b754 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:01.527650 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-f33c1370-9810-417f-9105-5626a8c2b754 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c" status: 200 len: 1722 microversion: 2.20 time: 0.158017 May 30 12:10:01.528239 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 365/743] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:10:01 2022] GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:10:02.545566 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-35734ba0-40f9-4dd8-8ca1-14fd969e58cd tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:02.546256 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-35734ba0-40f9-4dd8-8ca1-14fd969e58cd tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:02.553388 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-35734ba0-40f9-4dd8-8ca1-14fd969e58cd tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:02.553843 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-35734ba0-40f9-4dd8-8ca1-14fd969e58cd tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:02.554629 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-35734ba0-40f9-4dd8-8ca1-14fd969e58cd tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:02.555073 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-35734ba0-40f9-4dd8-8ca1-14fd969e58cd tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:02.685224 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-35734ba0-40f9-4dd8-8ca1-14fd969e58cd tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:02.693975 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-35734ba0-40f9-4dd8-8ca1-14fd969e58cd tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:02.695490 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-35734ba0-40f9-4dd8-8ca1-14fd969e58cd tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:02.696709 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-35734ba0-40f9-4dd8-8ca1-14fd969e58cd tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c" status: 200 len: 1743 microversion: 2.20 time: 0.155069 May 30 12:10:02.697265 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 379/744] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:10:02 2022] GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c => generated 1743 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:10:03.715583 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-7fe48d94-9cc7-492c-aace-a8cb9f7eec04 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:03.716224 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-7fe48d94-9cc7-492c-aace-a8cb9f7eec04 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:03.722749 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7fe48d94-9cc7-492c-aace-a8cb9f7eec04 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:03.723197 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7fe48d94-9cc7-492c-aace-a8cb9f7eec04 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:03.724775 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7fe48d94-9cc7-492c-aace-a8cb9f7eec04 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:03.725238 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7fe48d94-9cc7-492c-aace-a8cb9f7eec04 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:03.857413 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-7fe48d94-9cc7-492c-aace-a8cb9f7eec04 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:03.865339 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-7fe48d94-9cc7-492c-aace-a8cb9f7eec04 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:03.866844 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-7fe48d94-9cc7-492c-aace-a8cb9f7eec04 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:03.868008 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-7fe48d94-9cc7-492c-aace-a8cb9f7eec04 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c" status: 200 len: 1743 microversion: 2.20 time: 0.156466 May 30 12:10:03.868595 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 366/745] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:10:03 2022] GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c => generated 1743 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:10:04.885565 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-6765e32f-59db-4af5-bed7-abb42c1e7e6d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:04.886114 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-6765e32f-59db-4af5-bed7-abb42c1e7e6d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:04.892644 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-6765e32f-59db-4af5-bed7-abb42c1e7e6d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:04.893085 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-6765e32f-59db-4af5-bed7-abb42c1e7e6d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:04.894097 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-6765e32f-59db-4af5-bed7-abb42c1e7e6d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:04.894527 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-6765e32f-59db-4af5-bed7-abb42c1e7e6d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:04.909787 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:10:05.027041 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-6765e32f-59db-4af5-bed7-abb42c1e7e6d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:05.035256 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-6765e32f-59db-4af5-bed7-abb42c1e7e6d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:05.037246 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-6765e32f-59db-4af5-bed7-abb42c1e7e6d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:05.038561 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-6765e32f-59db-4af5-bed7-abb42c1e7e6d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c" status: 200 len: 1743 microversion: 2.20 time: 0.157016 May 30 12:10:05.039127 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 380/746] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:10:04 2022] GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c => generated 1743 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:10:06.057415 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-0b34bdfa-926b-40de-9c76-68296221af00 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:06.058031 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-0b34bdfa-926b-40de-9c76-68296221af00 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:06.064744 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-0b34bdfa-926b-40de-9c76-68296221af00 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:06.065203 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-0b34bdfa-926b-40de-9c76-68296221af00 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:06.065983 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-0b34bdfa-926b-40de-9c76-68296221af00 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:06.066423 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-0b34bdfa-926b-40de-9c76-68296221af00 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:06.197936 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-f0ec26fe-fd44-49c6-8e95-b8bbefb02481 req-0fd6a060-8736-451c-a153-5fde8015d87d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0614f5df-431f-4955-acdb-05894441016c", "name": "network-vif-plugged", "status": "completed", "tag": "e2714e9d-b17a-42e1-8920-55a988a1b563"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:10:06.207143 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-0b34bdfa-926b-40de-9c76-68296221af00 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:06.209184 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-f0ec26fe-fd44-49c6-8e95-b8bbefb02481 req-0fd6a060-8736-451c-a153-5fde8015d87d service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:06.209636 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-f0ec26fe-fd44-49c6-8e95-b8bbefb02481 req-0fd6a060-8736-451c-a153-5fde8015d87d service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:06.222735 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-0b34bdfa-926b-40de-9c76-68296221af00 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:06.223193 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-f0ec26fe-fd44-49c6-8e95-b8bbefb02481 req-0fd6a060-8736-451c-a153-5fde8015d87d service nova] Creating event network-vif-plugged:e2714e9d-b17a-42e1-8920-55a988a1b563 for instance 0614f5df-431f-4955-acdb-05894441016c on hv-cinder-84051 May 30 12:10:06.225110 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-0b34bdfa-926b-40de-9c76-68296221af00 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:06.226313 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-0b34bdfa-926b-40de-9c76-68296221af00 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c" status: 200 len: 1743 microversion: 2.20 time: 0.172880 May 30 12:10:06.227007 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 367/747] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:10:06 2022] GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c => generated 1743 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:10:06.230569 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-f0ec26fe-fd44-49c6-8e95-b8bbefb02481 req-0fd6a060-8736-451c-a153-5fde8015d87d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100903 May 30 12:10:06.231384 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 381/748] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:10:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:10:06.354333 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-e7c26e7c-86bc-45a1-bc46-8d1c6b2f06f0 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:06.356410 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-e7c26e7c-86bc-45a1-bc46-8d1c6b2f06f0 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 9c81cc0f-7430-4246-a05e-4670433f04ac] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:06.362438 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e7c26e7c-86bc-45a1-bc46-8d1c6b2f06f0 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:06.362956 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e7c26e7c-86bc-45a1-bc46-8d1c6b2f06f0 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:06.363821 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e7c26e7c-86bc-45a1-bc46-8d1c6b2f06f0 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:06.364411 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e7c26e7c-86bc-45a1-bc46-8d1c6b2f06f0 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:06.400644 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-e7c26e7c-86bc-45a1-bc46-8d1c6b2f06f0 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/9c81cc0f-7430-4246-a05e-4670433f04ac/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049997 May 30 12:10:06.401245 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 368/749] 10.222.0.32 () {58 vars in 1301 bytes} [Mon May 30 12:10:06 2022] GET /compute/v2.1/servers/9c81cc0f-7430-4246-a05e-4670433f04ac/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:10:06.550280 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-27aec007-0332-4496-a320-6a2e61da4fac tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:06.550863 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-27aec007-0332-4496-a320-6a2e61da4fac tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 9c81cc0f-7430-4246-a05e-4670433f04ac] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:06.559202 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-27aec007-0332-4496-a320-6a2e61da4fac tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:06.559661 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-27aec007-0332-4496-a320-6a2e61da4fac tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:06.560470 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-27aec007-0332-4496-a320-6a2e61da4fac tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:06.560967 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-27aec007-0332-4496-a320-6a2e61da4fac tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:06.596508 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-27aec007-0332-4496-a320-6a2e61da4fac tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/9c81cc0f-7430-4246-a05e-4670433f04ac/os-volume_attachments/1818ce5c-9fcf-4330-a039-62f00229c5c3" status: 200 len: 194 microversion: 2.1 time: 0.050706 May 30 12:10:06.597260 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 382/750] 10.222.0.32 () {58 vars in 1412 bytes} [Mon May 30 12:10:06 2022] GET /compute/v2.1/servers/9c81cc0f-7430-4246-a05e-4670433f04ac/os-volume_attachments/1818ce5c-9fcf-4330-a039-62f00229c5c3 => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:10:06.607529 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-fdd1ee91-bc46-4379-8460-9da999b38309 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:06.608031 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-fdd1ee91-bc46-4379-8460-9da999b38309 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 9c81cc0f-7430-4246-a05e-4670433f04ac] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:06.614020 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-fdd1ee91-bc46-4379-8460-9da999b38309 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:06.615239 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-fdd1ee91-bc46-4379-8460-9da999b38309 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:06.616072 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-fdd1ee91-bc46-4379-8460-9da999b38309 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:06.616585 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-fdd1ee91-bc46-4379-8460-9da999b38309 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:06.705685 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.objects.instance [None req-fdd1ee91-bc46-4379-8460-9da999b38309 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lazy-loading 'services' on Instance uuid 9c81cc0f-7430-4246-a05e-4670433f04ac {{(pid=117670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 30 12:10:06.787079 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-fdd1ee91-bc46-4379-8460-9da999b38309 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "DELETE /compute/v2.1/servers/9c81cc0f-7430-4246-a05e-4670433f04ac/os-volume_attachments/1818ce5c-9fcf-4330-a039-62f00229c5c3" status: 202 len: 0 microversion: 2.1 time: 0.182701 May 30 12:10:06.788097 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 369/751] 10.222.0.32 () {58 vars in 1415 bytes} [Mon May 30 12:10:06 2022] DELETE /compute/v2.1/servers/9c81cc0f-7430-4246-a05e-4670433f04ac/os-volume_attachments/1818ce5c-9fcf-4330-a039-62f00229c5c3 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 30 12:10:07.244875 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-44bc1b73-7d6e-4f85-8c08-6cfe4c7d19c4 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:07.245628 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-44bc1b73-7d6e-4f85-8c08-6cfe4c7d19c4 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:07.252130 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-44bc1b73-7d6e-4f85-8c08-6cfe4c7d19c4 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:07.252616 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-44bc1b73-7d6e-4f85-8c08-6cfe4c7d19c4 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:07.253391 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-44bc1b73-7d6e-4f85-8c08-6cfe4c7d19c4 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:07.253826 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-44bc1b73-7d6e-4f85-8c08-6cfe4c7d19c4 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:07.388689 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-44bc1b73-7d6e-4f85-8c08-6cfe4c7d19c4 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:07.401443 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-44bc1b73-7d6e-4f85-8c08-6cfe4c7d19c4 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:07.403848 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-44bc1b73-7d6e-4f85-8c08-6cfe4c7d19c4 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:07.405658 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-44bc1b73-7d6e-4f85-8c08-6cfe4c7d19c4 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c" status: 200 len: 1743 microversion: 2.20 time: 0.164604 May 30 12:10:07.406479 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 383/752] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:10:07 2022] GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c => generated 1743 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:10:07.988978 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-03b2e261-0121-4ef7-a83e-0a737d92e54f tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:07.990401 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-03b2e261-0121-4ef7-a83e-0a737d92e54f tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 9c81cc0f-7430-4246-a05e-4670433f04ac] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:07.997553 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-03b2e261-0121-4ef7-a83e-0a737d92e54f tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:07.998023 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-03b2e261-0121-4ef7-a83e-0a737d92e54f tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:07.998805 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-03b2e261-0121-4ef7-a83e-0a737d92e54f tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:07.999249 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-03b2e261-0121-4ef7-a83e-0a737d92e54f tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:08.032210 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-03b2e261-0121-4ef7-a83e-0a737d92e54f tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/9c81cc0f-7430-4246-a05e-4670433f04ac/os-volume_attachments/475479e1-cbf9-4cf3-9605-581a4a425337" status: 200 len: 194 microversion: 2.1 time: 0.048903 May 30 12:10:08.032997 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 370/753] 10.222.0.32 () {58 vars in 1412 bytes} [Mon May 30 12:10:07 2022] GET /compute/v2.1/servers/9c81cc0f-7430-4246-a05e-4670433f04ac/os-volume_attachments/475479e1-cbf9-4cf3-9605-581a4a425337 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:10:08.045260 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-ab39480d-5bf3-46f2-a5f9-0fffca871e91 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:08.046011 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-ab39480d-5bf3-46f2-a5f9-0fffca871e91 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 9c81cc0f-7430-4246-a05e-4670433f04ac] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:08.053401 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ab39480d-5bf3-46f2-a5f9-0fffca871e91 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:08.053861 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ab39480d-5bf3-46f2-a5f9-0fffca871e91 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:08.054858 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ab39480d-5bf3-46f2-a5f9-0fffca871e91 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:08.055304 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ab39480d-5bf3-46f2-a5f9-0fffca871e91 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:08.149396 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.objects.instance [None req-ab39480d-5bf3-46f2-a5f9-0fffca871e91 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lazy-loading 'services' on Instance uuid 9c81cc0f-7430-4246-a05e-4670433f04ac {{(pid=117671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 30 12:10:08.235945 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-ab39480d-5bf3-46f2-a5f9-0fffca871e91 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "DELETE /compute/v2.1/servers/9c81cc0f-7430-4246-a05e-4670433f04ac/os-volume_attachments/475479e1-cbf9-4cf3-9605-581a4a425337" status: 202 len: 0 microversion: 2.1 time: 0.196095 May 30 12:10:08.236669 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 384/754] 10.222.0.32 () {58 vars in 1415 bytes} [Mon May 30 12:10:08 2022] DELETE /compute/v2.1/servers/9c81cc0f-7430-4246-a05e-4670433f04ac/os-volume_attachments/475479e1-cbf9-4cf3-9605-581a4a425337 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 30 12:10:08.430183 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-bb695ece-4c2f-45de-bbbc-92e6307d2653 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:08.431165 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-bb695ece-4c2f-45de-bbbc-92e6307d2653 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:08.437428 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-bb695ece-4c2f-45de-bbbc-92e6307d2653 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:08.437900 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-bb695ece-4c2f-45de-bbbc-92e6307d2653 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:08.438618 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-bb695ece-4c2f-45de-bbbc-92e6307d2653 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:08.439058 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-bb695ece-4c2f-45de-bbbc-92e6307d2653 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:08.594788 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-bb695ece-4c2f-45de-bbbc-92e6307d2653 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:08.604376 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-bb695ece-4c2f-45de-bbbc-92e6307d2653 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:08.606049 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-bb695ece-4c2f-45de-bbbc-92e6307d2653 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:08.607350 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-bb695ece-4c2f-45de-bbbc-92e6307d2653 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c" status: 200 len: 1738 microversion: 2.20 time: 0.181919 May 30 12:10:08.608020 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 371/755] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:10:08 2022] GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c => generated 1738 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:10:09.630063 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-f9665d0f-655a-4396-be62-90ee4d89584b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:09.631624 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-f9665d0f-655a-4396-be62-90ee4d89584b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:09.638776 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f9665d0f-655a-4396-be62-90ee4d89584b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:09.639497 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f9665d0f-655a-4396-be62-90ee4d89584b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:09.640473 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f9665d0f-655a-4396-be62-90ee4d89584b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:09.641088 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f9665d0f-655a-4396-be62-90ee4d89584b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:09.801276 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-f9665d0f-655a-4396-be62-90ee4d89584b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:09.811100 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-f9665d0f-655a-4396-be62-90ee4d89584b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:09.812822 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-f9665d0f-655a-4396-be62-90ee4d89584b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:09.814371 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-f9665d0f-655a-4396-be62-90ee4d89584b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c" status: 200 len: 1738 microversion: 2.20 time: 0.192107 May 30 12:10:09.815465 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 385/756] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:10:09 2022] GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c => generated 1738 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:10:10.530011 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-2cd1b89a-61c6-46d2-87cb-dd72e4071f5b tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:10.531894 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-2cd1b89a-61c6-46d2-87cb-dd72e4071f5b tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 9c81cc0f-7430-4246-a05e-4670433f04ac] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:10.545375 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2cd1b89a-61c6-46d2-87cb-dd72e4071f5b tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:10.546071 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2cd1b89a-61c6-46d2-87cb-dd72e4071f5b tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:10.550478 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2cd1b89a-61c6-46d2-87cb-dd72e4071f5b tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:10.550836 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2cd1b89a-61c6-46d2-87cb-dd72e4071f5b tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:10.595108 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-2cd1b89a-61c6-46d2-87cb-dd72e4071f5b tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/9c81cc0f-7430-4246-a05e-4670433f04ac/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.068488 May 30 12:10:10.600500 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 372/757] 10.222.0.32 () {58 vars in 1301 bytes} [Mon May 30 12:10:10 2022] GET /compute/v2.1/servers/9c81cc0f-7430-4246-a05e-4670433f04ac/os-volume_attachments => generated 25 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 30 12:10:10.733613 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-73762986-9156-47aa-aab8-390b2c37e025 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:10.734913 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-73762986-9156-47aa-aab8-390b2c37e025 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 9c81cc0f-7430-4246-a05e-4670433f04ac] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:10.742439 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-73762986-9156-47aa-aab8-390b2c37e025 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:10.743029 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-73762986-9156-47aa-aab8-390b2c37e025 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:10.743922 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-73762986-9156-47aa-aab8-390b2c37e025 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:10.744518 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-73762986-9156-47aa-aab8-390b2c37e025 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:10.780552 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-73762986-9156-47aa-aab8-390b2c37e025 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/9c81cc0f-7430-4246-a05e-4670433f04ac/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051437 May 30 12:10:10.781335 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 386/758] 10.222.0.32 () {58 vars in 1301 bytes} [Mon May 30 12:10:10 2022] GET /compute/v2.1/servers/9c81cc0f-7430-4246-a05e-4670433f04ac/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 30 12:10:10.835778 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-45dc5bf0-804b-44fd-8372-90123636cabb tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:10.836514 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-45dc5bf0-804b-44fd-8372-90123636cabb tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:10.848743 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-45dc5bf0-804b-44fd-8372-90123636cabb tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:10.849620 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-45dc5bf0-804b-44fd-8372-90123636cabb tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:10.852793 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-45dc5bf0-804b-44fd-8372-90123636cabb tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:10.854035 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-45dc5bf0-804b-44fd-8372-90123636cabb tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:10.871752 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-d613c4c1-c163-4cef-b8f6-e784e7f36dfe tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:10.872617 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-d613c4c1-c163-4cef-b8f6-e784e7f36dfe tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 9c81cc0f-7430-4246-a05e-4670433f04ac] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:10.886285 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d613c4c1-c163-4cef-b8f6-e784e7f36dfe tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:10.886949 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d613c4c1-c163-4cef-b8f6-e784e7f36dfe tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:10.888281 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d613c4c1-c163-4cef-b8f6-e784e7f36dfe tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:10.890762 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d613c4c1-c163-4cef-b8f6-e784e7f36dfe tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:10.934190 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-d613c4c1-c163-4cef-b8f6-e784e7f36dfe tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 9c81cc0f-7430-4246-a05e-4670433f04ac] Going to try to terminate instance {{(pid=117671) delete /opt/stack/nova/nova/compute/api.py:2664}} May 30 12:10:11.063336 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-d613c4c1-c163-4cef-b8f6-e784e7f36dfe tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "DELETE /compute/v2.1/servers/9c81cc0f-7430-4246-a05e-4670433f04ac" status: 204 len: 0 microversion: 2.1 time: 0.194305 May 30 12:10:11.064888 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 387/759] 10.222.0.32 () {58 vars in 1238 bytes} [Mon May 30 12:10:10 2022] DELETE /compute/v2.1/servers/9c81cc0f-7430-4246-a05e-4670433f04ac => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 30 12:10:11.079034 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-d23eaecb-8e9a-4d1a-86e5-4526cd923d18 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:11.079751 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-d23eaecb-8e9a-4d1a-86e5-4526cd923d18 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 9c81cc0f-7430-4246-a05e-4670433f04ac] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:11.086815 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d23eaecb-8e9a-4d1a-86e5-4526cd923d18 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:11.087282 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d23eaecb-8e9a-4d1a-86e5-4526cd923d18 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:11.088767 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d23eaecb-8e9a-4d1a-86e5-4526cd923d18 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:11.089341 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d23eaecb-8e9a-4d1a-86e5-4526cd923d18 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:11.107612 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-45dc5bf0-804b-44fd-8372-90123636cabb tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:11.118756 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-45dc5bf0-804b-44fd-8372-90123636cabb tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:11.120565 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-45dc5bf0-804b-44fd-8372-90123636cabb tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:11.121989 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-45dc5bf0-804b-44fd-8372-90123636cabb tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c" status: 200 len: 1738 microversion: 2.20 time: 0.292683 May 30 12:10:11.123079 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 373/760] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:10:10 2022] GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c => generated 1738 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:10:11.249964 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-d23eaecb-8e9a-4d1a-86e5-4526cd923d18 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76e8d7bfdc04ea79c83ca7fb6b9ade1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5074cf3e6248668995f266845c8969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:11.260752 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-d23eaecb-8e9a-4d1a-86e5-4526cd923d18 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/9c81cc0f-7430-4246-a05e-4670433f04ac" status: 200 len: 1675 microversion: 2.1 time: 0.190642 May 30 12:10:11.261508 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 388/761] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:10:11 2022] GET /compute/v2.1/servers/9c81cc0f-7430-4246-a05e-4670433f04ac => generated 1675 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:10:12.144543 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-04db9c6f-1572-4e8e-a797-355556e947ed tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:12.146992 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-04db9c6f-1572-4e8e-a797-355556e947ed tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:12.153797 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-04db9c6f-1572-4e8e-a797-355556e947ed tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:12.154627 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-04db9c6f-1572-4e8e-a797-355556e947ed tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:12.155650 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-04db9c6f-1572-4e8e-a797-355556e947ed tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:12.156481 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-04db9c6f-1572-4e8e-a797-355556e947ed tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:12.280717 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-7f05758a-bc79-4c6b-875d-81295d7638f5 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:12.281972 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-7f05758a-bc79-4c6b-875d-81295d7638f5 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 9c81cc0f-7430-4246-a05e-4670433f04ac] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:12.297827 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7f05758a-bc79-4c6b-875d-81295d7638f5 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:12.300689 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7f05758a-bc79-4c6b-875d-81295d7638f5 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:12.303405 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7f05758a-bc79-4c6b-875d-81295d7638f5 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:12.304611 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7f05758a-bc79-4c6b-875d-81295d7638f5 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:12.340914 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-04db9c6f-1572-4e8e-a797-355556e947ed tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:12.352502 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-04db9c6f-1572-4e8e-a797-355556e947ed tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:12.354815 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-04db9c6f-1572-4e8e-a797-355556e947ed tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:12.357293 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-04db9c6f-1572-4e8e-a797-355556e947ed tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c" status: 200 len: 1738 microversion: 2.20 time: 0.218196 May 30 12:10:12.369848 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 374/762] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:10:12 2022] GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c => generated 1738 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 30 12:10:12.480865 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-7f05758a-bc79-4c6b-875d-81295d7638f5 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76e8d7bfdc04ea79c83ca7fb6b9ade1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5074cf3e6248668995f266845c8969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:12.488689 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-7f05758a-bc79-4c6b-875d-81295d7638f5 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/9c81cc0f-7430-4246-a05e-4670433f04ac" status: 200 len: 1675 microversion: 2.1 time: 0.213753 May 30 12:10:12.490361 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 389/763] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:10:12 2022] GET /compute/v2.1/servers/9c81cc0f-7430-4246-a05e-4670433f04ac => generated 1675 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:10:13.384655 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-94c9efa7-a50e-42e3-b04a-ca392968ee0c tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:13.385801 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-94c9efa7-a50e-42e3-b04a-ca392968ee0c tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:13.397879 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-94c9efa7-a50e-42e3-b04a-ca392968ee0c tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:13.398556 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-94c9efa7-a50e-42e3-b04a-ca392968ee0c tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:13.399527 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-94c9efa7-a50e-42e3-b04a-ca392968ee0c tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:13.400153 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-94c9efa7-a50e-42e3-b04a-ca392968ee0c tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:13.510311 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-50e2f9cd-b3c9-44de-b8e7-ca1276f51792 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:13.511980 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-50e2f9cd-b3c9-44de-b8e7-ca1276f51792 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 9c81cc0f-7430-4246-a05e-4670433f04ac] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:13.520297 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-50e2f9cd-b3c9-44de-b8e7-ca1276f51792 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:13.520758 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-50e2f9cd-b3c9-44de-b8e7-ca1276f51792 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:13.521629 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-50e2f9cd-b3c9-44de-b8e7-ca1276f51792 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:13.522086 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-50e2f9cd-b3c9-44de-b8e7-ca1276f51792 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:13.606736 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-94c9efa7-a50e-42e3-b04a-ca392968ee0c tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:13.615877 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-94c9efa7-a50e-42e3-b04a-ca392968ee0c tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:13.617939 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-94c9efa7-a50e-42e3-b04a-ca392968ee0c tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:13.619580 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-94c9efa7-a50e-42e3-b04a-ca392968ee0c tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c" status: 200 len: 1738 microversion: 2.20 time: 0.244037 May 30 12:10:13.620760 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 375/764] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:10:13 2022] GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c => generated 1738 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:10:13.694666 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-50e2f9cd-b3c9-44de-b8e7-ca1276f51792 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76e8d7bfdc04ea79c83ca7fb6b9ade1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5074cf3e6248668995f266845c8969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:13.704091 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-50e2f9cd-b3c9-44de-b8e7-ca1276f51792 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/9c81cc0f-7430-4246-a05e-4670433f04ac" status: 200 len: 1675 microversion: 2.1 time: 0.197473 May 30 12:10:13.704890 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 390/765] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:10:13 2022] GET /compute/v2.1/servers/9c81cc0f-7430-4246-a05e-4670433f04ac => generated 1675 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:10:14.639344 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-1a5ffb82-3bd7-4901-af01-0c1ef23a56ff tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:14.640632 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-1a5ffb82-3bd7-4901-af01-0c1ef23a56ff tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:14.651503 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1a5ffb82-3bd7-4901-af01-0c1ef23a56ff tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:14.651957 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1a5ffb82-3bd7-4901-af01-0c1ef23a56ff tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:14.652776 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1a5ffb82-3bd7-4901-af01-0c1ef23a56ff tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:14.653275 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1a5ffb82-3bd7-4901-af01-0c1ef23a56ff tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:14.722001 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-13c72c4e-25d8-430b-8038-ec5a8477e94e tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:14.722663 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-13c72c4e-25d8-430b-8038-ec5a8477e94e tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 9c81cc0f-7430-4246-a05e-4670433f04ac] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:14.741253 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-13c72c4e-25d8-430b-8038-ec5a8477e94e tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:14.741818 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-13c72c4e-25d8-430b-8038-ec5a8477e94e tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:14.742685 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-13c72c4e-25d8-430b-8038-ec5a8477e94e tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:14.743196 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-13c72c4e-25d8-430b-8038-ec5a8477e94e tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:14.917544 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-1a5ffb82-3bd7-4901-af01-0c1ef23a56ff tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:14.931837 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-1a5ffb82-3bd7-4901-af01-0c1ef23a56ff tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:14.933473 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-1a5ffb82-3bd7-4901-af01-0c1ef23a56ff tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:14.934697 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-1a5ffb82-3bd7-4901-af01-0c1ef23a56ff tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c" status: 200 len: 1738 microversion: 2.20 time: 0.299869 May 30 12:10:14.938717 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 376/766] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:10:14 2022] GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c => generated 1738 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:10:14.947582 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-13c72c4e-25d8-430b-8038-ec5a8477e94e tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76e8d7bfdc04ea79c83ca7fb6b9ade1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5074cf3e6248668995f266845c8969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:14.959923 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-13c72c4e-25d8-430b-8038-ec5a8477e94e tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/9c81cc0f-7430-4246-a05e-4670433f04ac" status: 200 len: 1675 microversion: 2.1 time: 0.241132 May 30 12:10:14.960863 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 391/767] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:10:14 2022] GET /compute/v2.1/servers/9c81cc0f-7430-4246-a05e-4670433f04ac => generated 1675 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:10:15.953826 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-c6756521-b7c8-4000-a8f7-0a48b87c01df tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:15.955143 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-c6756521-b7c8-4000-a8f7-0a48b87c01df tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:15.969915 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c6756521-b7c8-4000-a8f7-0a48b87c01df tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:15.972308 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c6756521-b7c8-4000-a8f7-0a48b87c01df tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:15.973913 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c6756521-b7c8-4000-a8f7-0a48b87c01df tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:15.974579 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c6756521-b7c8-4000-a8f7-0a48b87c01df tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:15.977959 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:10:15.978887 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-8e169e04-8c95-43e3-a860-8ae1e8849c88 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:15.979860 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-8e169e04-8c95-43e3-a860-8ae1e8849c88 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 9c81cc0f-7430-4246-a05e-4670433f04ac] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:15.995521 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:10:15.997536 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8e169e04-8c95-43e3-a860-8ae1e8849c88 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:15.998118 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8e169e04-8c95-43e3-a860-8ae1e8849c88 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:15.999083 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8e169e04-8c95-43e3-a860-8ae1e8849c88 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:16.000264 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8e169e04-8c95-43e3-a860-8ae1e8849c88 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:16.204625 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-c6756521-b7c8-4000-a8f7-0a48b87c01df tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:16.222290 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-c6756521-b7c8-4000-a8f7-0a48b87c01df tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:16.224041 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-c6756521-b7c8-4000-a8f7-0a48b87c01df tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:16.237175 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-c6756521-b7c8-4000-a8f7-0a48b87c01df tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c" status: 200 len: 1738 microversion: 2.20 time: 0.287492 May 30 12:10:16.237791 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 377/768] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:10:15 2022] GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c => generated 1738 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:10:16.272886 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-8e169e04-8c95-43e3-a860-8ae1e8849c88 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76e8d7bfdc04ea79c83ca7fb6b9ade1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5074cf3e6248668995f266845c8969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:16.283274 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-8e169e04-8c95-43e3-a860-8ae1e8849c88 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/9c81cc0f-7430-4246-a05e-4670433f04ac" status: 200 len: 1675 microversion: 2.1 time: 0.308817 May 30 12:10:16.283850 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 392/769] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:10:15 2022] GET /compute/v2.1/servers/9c81cc0f-7430-4246-a05e-4670433f04ac => generated 1675 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:10:16.981680 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-779e2a44-a8fb-4539-b600-3bf37cee2bcf req-09473479-7cf5-487e-8a92-27331cdcd337 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c81cc0f-7430-4246-a05e-4670433f04ac", "name": "network-vif-deleted", "tag": "f11c8f02-5789-4508-b902-db1e07686c56"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:10:16.999508 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-779e2a44-a8fb-4539-b600-3bf37cee2bcf req-09473479-7cf5-487e-8a92-27331cdcd337 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:17.000567 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-779e2a44-a8fb-4539-b600-3bf37cee2bcf req-09473479-7cf5-487e-8a92-27331cdcd337 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:17.022646 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-779e2a44-a8fb-4539-b600-3bf37cee2bcf req-09473479-7cf5-487e-8a92-27331cdcd337 service nova] Creating event network-vif-deleted:f11c8f02-5789-4508-b902-db1e07686c56 for instance 9c81cc0f-7430-4246-a05e-4670433f04ac on hv-cinder-84051 May 30 12:10:17.032184 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-779e2a44-a8fb-4539-b600-3bf37cee2bcf req-09473479-7cf5-487e-8a92-27331cdcd337 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056299 May 30 12:10:17.033342 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 378/770] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:10:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:10:17.263870 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-a6c05561-309e-4d2a-ba07-4fc76ba39bcc tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:17.265360 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-a6c05561-309e-4d2a-ba07-4fc76ba39bcc tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:17.272047 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a6c05561-309e-4d2a-ba07-4fc76ba39bcc tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:17.272804 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a6c05561-309e-4d2a-ba07-4fc76ba39bcc tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:17.273759 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a6c05561-309e-4d2a-ba07-4fc76ba39bcc tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:17.274369 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a6c05561-309e-4d2a-ba07-4fc76ba39bcc tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:17.300775 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-811d11fc-0abe-4782-b46c-681f6f0b22f9 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:17.301561 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-811d11fc-0abe-4782-b46c-681f6f0b22f9 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 9c81cc0f-7430-4246-a05e-4670433f04ac] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:17.315467 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-811d11fc-0abe-4782-b46c-681f6f0b22f9 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:17.315920 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-811d11fc-0abe-4782-b46c-681f6f0b22f9 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:17.316731 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-811d11fc-0abe-4782-b46c-681f6f0b22f9 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:17.317234 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-811d11fc-0abe-4782-b46c-681f6f0b22f9 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:17.381196 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-811d11fc-0abe-4782-b46c-681f6f0b22f9 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:17.381907 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-811d11fc-0abe-4782-b46c-681f6f0b22f9 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:17.382753 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.objects.instance [None req-811d11fc-0abe-4782-b46c-681f6f0b22f9 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lazy-loading 'fault' on Instance uuid 9c81cc0f-7430-4246-a05e-4670433f04ac {{(pid=117670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 30 12:10:17.450226 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-a6c05561-309e-4d2a-ba07-4fc76ba39bcc tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:17.462774 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-a6c05561-309e-4d2a-ba07-4fc76ba39bcc tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:17.466081 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-a6c05561-309e-4d2a-ba07-4fc76ba39bcc tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:17.470111 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-a6c05561-309e-4d2a-ba07-4fc76ba39bcc tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c" status: 200 len: 1738 microversion: 2.20 time: 0.217563 May 30 12:10:17.471578 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 393/771] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:10:17 2022] GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c => generated 1738 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:10:17.488584 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-811d11fc-0abe-4782-b46c-681f6f0b22f9 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c76e8d7bfdc04ea79c83ca7fb6b9ade1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5074cf3e6248668995f266845c8969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:17.498561 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-811d11fc-0abe-4782-b46c-681f6f0b22f9 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/9c81cc0f-7430-4246-a05e-4670433f04ac" status: 200 len: 1327 microversion: 2.1 time: 0.202089 May 30 12:10:17.510663 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 379/772] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:10:17 2022] GET /compute/v2.1/servers/9c81cc0f-7430-4246-a05e-4670433f04ac => generated 1327 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:10:18.490919 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-a211eed0-559b-430b-81f2-c19001930e75 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:18.491702 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-a211eed0-559b-430b-81f2-c19001930e75 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:18.498158 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a211eed0-559b-430b-81f2-c19001930e75 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:18.498629 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a211eed0-559b-430b-81f2-c19001930e75 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:18.499386 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a211eed0-559b-430b-81f2-c19001930e75 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:18.499822 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a211eed0-559b-430b-81f2-c19001930e75 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:18.517023 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-30e54c0b-af9d-4f68-b538-465276da777b tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:18.517665 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-30e54c0b-af9d-4f68-b538-465276da777b tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 9c81cc0f-7430-4246-a05e-4670433f04ac] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:18.524684 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-30e54c0b-af9d-4f68-b538-465276da777b tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:18.525144 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-30e54c0b-af9d-4f68-b538-465276da777b tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:18.525925 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-30e54c0b-af9d-4f68-b538-465276da777b tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:18.526367 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-30e54c0b-af9d-4f68-b538-465276da777b tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:18.541439 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.wsgi [None req-30e54c0b-af9d-4f68-b538-465276da777b tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] HTTP exception thrown: Instance 9c81cc0f-7430-4246-a05e-4670433f04ac could not be found. May 30 12:10:18.543135 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-30e54c0b-af9d-4f68-b538-465276da777b tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Request method failure captured: May 30 12:10:18.543135 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: request: GET /compute/v2.1/servers/9c81cc0f-7430-4246-a05e-4670433f04ac HTTP/1.1 May 30 12:10:18.543135 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Accept: application/json May 30 12:10:18.543135 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Accept-Encoding: identity May 30 12:10:18.543135 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Connection: close May 30 12:10:18.543135 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Content-Length: 0 May 30 12:10:18.543135 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Content-Type: application/json May 30 12:10:18.543135 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Host: 10.222.0.32 May 30 12:10:18.543135 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Openstack-System-Scope: None May 30 12:10:18.543135 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: User-Agent: python-urllib3/1.26.9 May 30 12:10:18.543135 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Auth-Token: gAAAAABilLK4IddkunCo0Xmjrms8ofv8_gpbvwTsl-mso90Gd-x4mCJoeDTHM6sXVesnqNGpnDpFAQG8d_YdpsH3sRAOPyTza0DMw9keL1RdMfuWo3t12sQTo4M7obVAI5TL8y9jPYTTnwfsh-ZnAj255hOWPH4AJlfv00aeUv7tlc7kqVzUCJk May 30 12:10:18.543135 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Domain-Id: None May 30 12:10:18.543135 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Domain-Name: None May 30 12:10:18.543135 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Identity-Status: Confirmed May 30 12:10:18.543135 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Is-Admin-Project: True May 30 12:10:18.543135 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Domain-Id: default May 30 12:10:18.543135 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Domain-Name: Default May 30 12:10:18.543135 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Id: 8b5074cf3e6248668995f266845c8969 May 30 12:10:18.543135 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Name: tempest-AttachVolumeTestJSON-836453923 May 30 12:10:18.543135 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Role: reader,member May 30 12:10:18.543135 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Roles: reader,member May 30 12:10:18.544874 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/8b5074cf3e6248668995f266845c8969"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/8b5074cf3e6248668995f266845c8969"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/8b5074cf3e6248668995f266845c8969"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_8b5074cf3e6248668995f266845c8969", "adminURL": "http://10.222.0.32:8080"}]}] May 30 12:10:18.544874 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant: tempest-AttachVolumeTestJSON-836453923 May 30 12:10:18.544874 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant-Id: 8b5074cf3e6248668995f266845c8969 May 30 12:10:18.544874 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant-Name: tempest-AttachVolumeTestJSON-836453923 May 30 12:10:18.544874 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User: tempest-AttachVolumeTestJSON-836453923-project May 30 12:10:18.544874 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Domain-Id: default May 30 12:10:18.544874 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Domain-Name: Default May 30 12:10:18.544874 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Id: c76e8d7bfdc04ea79c83ca7fb6b9ade1 May 30 12:10:18.544874 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Name: tempest-AttachVolumeTestJSON-836453923-project May 30 12:10:18.544874 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: method: > May 30 12:10:18.544874 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: exception: Instance 9c81cc0f-7430-4246-a05e-4670433f04ac could not be found. May 30 12:10:18.544874 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: action_args: {'id': '9c81cc0f-7430-4246-a05e-4670433f04ac'} May 30 12:10:18.549278 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:10:18.549278 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:10:18.549278 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:10:18.549278 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:10:18.549278 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:10:18.549278 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:10:18.549278 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:10:18.549278 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:10:18.549278 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:10:18.549278 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:10:18.549278 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c81cc0f-7430-4246-a05e-4670433f04ac could not be found. May 30 12:10:18.549278 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:10:18.549278 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:10:18.549278 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:10:18.549278 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:10:18.549278 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:10:18.549278 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:10:18.549278 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:10:18.549278 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:10:18.549278 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:10:18.550825 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:10:18.550825 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 30 12:10:18.550825 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 30 12:10:18.550825 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 30 12:10:18.550825 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 30 12:10:18.550825 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:10:18.550825 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:10:18.550825 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c81cc0f-7430-4246-a05e-4670433f04ac could not be found. May 30 12:10:18.550825 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:10:18.550825 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:10:18.550825 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:10:18.550825 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:10:18.550825 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:10:18.550825 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:10:18.550825 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:10:18.550825 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:10:18.550825 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c81cc0f-7430-4246-a05e-4670433f04ac could not be found. May 30 12:10:18.550825 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:10:18.553212 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-30e54c0b-af9d-4f68-b538-465276da777b tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Returning 404 to user: Instance 9c81cc0f-7430-4246-a05e-4670433f04ac could not be found. {{(pid=117670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:10:18.553212 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-30e54c0b-af9d-4f68-b538-465276da777b tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/9c81cc0f-7430-4246-a05e-4670433f04ac" status: 404 len: 111 microversion: 2.1 time: 0.032343 May 30 12:10:18.553212 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 380/773] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:10:18 2022] GET /compute/v2.1/servers/9c81cc0f-7430-4246-a05e-4670433f04ac => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 30 12:10:18.555712 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-fdbdde75-2f32-4d71-9b3c-eb3eff6dd90f tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '.version_select at 0x7f0ef873e820>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:18.577830 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-fdbdde75-2f32-4d71-9b3c-eb3eff6dd90f tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-266343112" status: 202 len: 0 microversion: 2.1 time: 0.027007 May 30 12:10:18.579078 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 381/774] 10.222.0.32 () {58 vars in 1217 bytes} [Mon May 30 12:10:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-266343112 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 30 12:10:18.664584 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-a211eed0-559b-430b-81f2-c19001930e75 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:18.674212 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-a211eed0-559b-430b-81f2-c19001930e75 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:18.676038 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-a211eed0-559b-430b-81f2-c19001930e75 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:18.678017 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-a211eed0-559b-430b-81f2-c19001930e75 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c" status: 200 len: 1738 microversion: 2.20 time: 0.191976 May 30 12:10:18.678811 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 394/775] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:10:18 2022] GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c => generated 1738 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:10:19.697470 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-8d7d584a-b66f-4d0e-9cda-80f4211d0caf tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:19.698127 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-8d7d584a-b66f-4d0e-9cda-80f4211d0caf tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:19.710298 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8d7d584a-b66f-4d0e-9cda-80f4211d0caf tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:19.710745 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8d7d584a-b66f-4d0e-9cda-80f4211d0caf tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:19.711691 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8d7d584a-b66f-4d0e-9cda-80f4211d0caf tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:19.712186 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8d7d584a-b66f-4d0e-9cda-80f4211d0caf tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:19.856051 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-8d7d584a-b66f-4d0e-9cda-80f4211d0caf tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:19.864818 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-8d7d584a-b66f-4d0e-9cda-80f4211d0caf tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:19.866359 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-8d7d584a-b66f-4d0e-9cda-80f4211d0caf tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:19.867549 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-8d7d584a-b66f-4d0e-9cda-80f4211d0caf tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c" status: 200 len: 1720 microversion: 2.20 time: 0.174074 May 30 12:10:19.868145 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 382/776] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:10:19 2022] GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c => generated 1720 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:10:20.887390 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-6d371fd6-2fbb-4be7-bf47-ea5a6443986b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:20.888418 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-6d371fd6-2fbb-4be7-bf47-ea5a6443986b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:20.897604 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-6d371fd6-2fbb-4be7-bf47-ea5a6443986b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:20.898059 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-6d371fd6-2fbb-4be7-bf47-ea5a6443986b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:20.898840 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-6d371fd6-2fbb-4be7-bf47-ea5a6443986b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:20.899274 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-6d371fd6-2fbb-4be7-bf47-ea5a6443986b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:20.916601 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:10:21.335519 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-6d371fd6-2fbb-4be7-bf47-ea5a6443986b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:21.344500 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-6d371fd6-2fbb-4be7-bf47-ea5a6443986b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:21.346331 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-6d371fd6-2fbb-4be7-bf47-ea5a6443986b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:21.347589 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-6d371fd6-2fbb-4be7-bf47-ea5a6443986b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c" status: 200 len: 1720 microversion: 2.20 time: 0.465178 May 30 12:10:21.349169 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 395/777] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:10:20 2022] GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c => generated 1720 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:10:21.506609 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-fd6f9c8e-b5ac-4773-b889-8cf480ff7b35 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:21.507257 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-fd6f9c8e-b5ac-4773-b889-8cf480ff7b35 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 9c81cc0f-7430-4246-a05e-4670433f04ac] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:21.515754 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-fd6f9c8e-b5ac-4773-b889-8cf480ff7b35 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:21.516330 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-fd6f9c8e-b5ac-4773-b889-8cf480ff7b35 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:21.517277 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-fd6f9c8e-b5ac-4773-b889-8cf480ff7b35 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:21.517898 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-fd6f9c8e-b5ac-4773-b889-8cf480ff7b35 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:21.541215 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.wsgi [None req-fd6f9c8e-b5ac-4773-b889-8cf480ff7b35 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] HTTP exception thrown: Instance 9c81cc0f-7430-4246-a05e-4670433f04ac could not be found. May 30 12:10:21.542859 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-fd6f9c8e-b5ac-4773-b889-8cf480ff7b35 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Request method failure captured: May 30 12:10:21.542859 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: request: DELETE /compute/v2.1/servers/9c81cc0f-7430-4246-a05e-4670433f04ac HTTP/1.1 May 30 12:10:21.542859 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Accept: application/json May 30 12:10:21.542859 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Accept-Encoding: identity May 30 12:10:21.542859 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Connection: close May 30 12:10:21.542859 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Content-Length: 0 May 30 12:10:21.542859 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Content-Type: application/json May 30 12:10:21.542859 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Host: 10.222.0.32 May 30 12:10:21.542859 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Openstack-System-Scope: None May 30 12:10:21.542859 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: User-Agent: python-urllib3/1.26.9 May 30 12:10:21.542859 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Auth-Token: gAAAAABilLK4IddkunCo0Xmjrms8ofv8_gpbvwTsl-mso90Gd-x4mCJoeDTHM6sXVesnqNGpnDpFAQG8d_YdpsH3sRAOPyTza0DMw9keL1RdMfuWo3t12sQTo4M7obVAI5TL8y9jPYTTnwfsh-ZnAj255hOWPH4AJlfv00aeUv7tlc7kqVzUCJk May 30 12:10:21.542859 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Domain-Id: None May 30 12:10:21.542859 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Domain-Name: None May 30 12:10:21.542859 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Identity-Status: Confirmed May 30 12:10:21.542859 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Is-Admin-Project: True May 30 12:10:21.542859 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Domain-Id: default May 30 12:10:21.542859 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Domain-Name: Default May 30 12:10:21.542859 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Id: 8b5074cf3e6248668995f266845c8969 May 30 12:10:21.542859 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Name: tempest-AttachVolumeTestJSON-836453923 May 30 12:10:21.542859 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Role: reader,member May 30 12:10:21.542859 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Roles: reader,member May 30 12:10:21.545247 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/8b5074cf3e6248668995f266845c8969"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/8b5074cf3e6248668995f266845c8969"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/8b5074cf3e6248668995f266845c8969"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_8b5074cf3e6248668995f266845c8969", "adminURL": "http://10.222.0.32:8080"}]}] May 30 12:10:21.545247 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant: tempest-AttachVolumeTestJSON-836453923 May 30 12:10:21.545247 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant-Id: 8b5074cf3e6248668995f266845c8969 May 30 12:10:21.545247 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant-Name: tempest-AttachVolumeTestJSON-836453923 May 30 12:10:21.545247 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User: tempest-AttachVolumeTestJSON-836453923-project May 30 12:10:21.545247 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Domain-Id: default May 30 12:10:21.545247 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Domain-Name: Default May 30 12:10:21.545247 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Id: c76e8d7bfdc04ea79c83ca7fb6b9ade1 May 30 12:10:21.545247 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Name: tempest-AttachVolumeTestJSON-836453923-project May 30 12:10:21.545247 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: method: > May 30 12:10:21.545247 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: exception: Instance 9c81cc0f-7430-4246-a05e-4670433f04ac could not be found. May 30 12:10:21.545247 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: action_args: {'id': '9c81cc0f-7430-4246-a05e-4670433f04ac'} May 30 12:10:21.546237 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:10:21.546237 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:10:21.546237 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:10:21.546237 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:10:21.546237 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:10:21.546237 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:10:21.546237 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:10:21.546237 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:10:21.546237 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:10:21.546237 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:10:21.546237 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c81cc0f-7430-4246-a05e-4670433f04ac could not be found. May 30 12:10:21.546237 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:10:21.546237 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:10:21.546237 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:10:21.546237 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:10:21.546237 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:10:21.546237 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:10:21.546237 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:10:21.546237 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:10:21.546237 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:10:21.548066 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:10:21.548066 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 30 12:10:21.548066 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 30 12:10:21.548066 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 30 12:10:21.548066 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 30 12:10:21.548066 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 30 12:10:21.548066 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 30 12:10:21.548066 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:10:21.548066 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:10:21.548066 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c81cc0f-7430-4246-a05e-4670433f04ac could not be found. May 30 12:10:21.548066 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:10:21.548066 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:10:21.548066 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:10:21.548066 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:10:21.548066 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:10:21.548066 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:10:21.548066 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:10:21.548066 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:10:21.548066 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c81cc0f-7430-4246-a05e-4670433f04ac could not be found. May 30 12:10:21.548066 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:10:21.550448 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-fd6f9c8e-b5ac-4773-b889-8cf480ff7b35 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Returning 404 to user: Instance 9c81cc0f-7430-4246-a05e-4670433f04ac could not be found. {{(pid=117670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:10:21.550448 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-fd6f9c8e-b5ac-4773-b889-8cf480ff7b35 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "DELETE /compute/v2.1/servers/9c81cc0f-7430-4246-a05e-4670433f04ac" status: 404 len: 111 microversion: 2.1 time: 0.043525 May 30 12:10:21.550448 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 383/778] 10.222.0.32 () {58 vars in 1238 bytes} [Mon May 30 12:10:21 2022] DELETE /compute/v2.1/servers/9c81cc0f-7430-4246-a05e-4670433f04ac => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 30 12:10:21.555974 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-f8aaa65a-2082-42dc-8a86-88222e912ca8 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:21.556663 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-f8aaa65a-2082-42dc-8a86-88222e912ca8 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 9c81cc0f-7430-4246-a05e-4670433f04ac] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:21.562667 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f8aaa65a-2082-42dc-8a86-88222e912ca8 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:21.563127 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f8aaa65a-2082-42dc-8a86-88222e912ca8 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:21.563978 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f8aaa65a-2082-42dc-8a86-88222e912ca8 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:21.564435 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f8aaa65a-2082-42dc-8a86-88222e912ca8 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:21.583595 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.wsgi [None req-f8aaa65a-2082-42dc-8a86-88222e912ca8 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] HTTP exception thrown: Instance 9c81cc0f-7430-4246-a05e-4670433f04ac could not be found. May 30 12:10:21.585426 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-f8aaa65a-2082-42dc-8a86-88222e912ca8 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Request method failure captured: May 30 12:10:21.585426 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: request: GET /compute/v2.1/servers/9c81cc0f-7430-4246-a05e-4670433f04ac HTTP/1.1 May 30 12:10:21.585426 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Accept: application/json May 30 12:10:21.585426 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Accept-Encoding: identity May 30 12:10:21.585426 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Connection: close May 30 12:10:21.585426 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Content-Length: 0 May 30 12:10:21.585426 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Content-Type: application/json May 30 12:10:21.585426 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Host: 10.222.0.32 May 30 12:10:21.585426 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Openstack-System-Scope: None May 30 12:10:21.585426 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: User-Agent: python-urllib3/1.26.9 May 30 12:10:21.585426 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Auth-Token: gAAAAABilLK4IddkunCo0Xmjrms8ofv8_gpbvwTsl-mso90Gd-x4mCJoeDTHM6sXVesnqNGpnDpFAQG8d_YdpsH3sRAOPyTza0DMw9keL1RdMfuWo3t12sQTo4M7obVAI5TL8y9jPYTTnwfsh-ZnAj255hOWPH4AJlfv00aeUv7tlc7kqVzUCJk May 30 12:10:21.585426 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Domain-Id: None May 30 12:10:21.585426 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Domain-Name: None May 30 12:10:21.585426 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Identity-Status: Confirmed May 30 12:10:21.585426 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Is-Admin-Project: True May 30 12:10:21.585426 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Domain-Id: default May 30 12:10:21.585426 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Domain-Name: Default May 30 12:10:21.585426 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Id: 8b5074cf3e6248668995f266845c8969 May 30 12:10:21.585426 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Name: tempest-AttachVolumeTestJSON-836453923 May 30 12:10:21.585426 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Role: reader,member May 30 12:10:21.585426 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Roles: reader,member May 30 12:10:21.587043 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/8b5074cf3e6248668995f266845c8969"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/8b5074cf3e6248668995f266845c8969"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/8b5074cf3e6248668995f266845c8969"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_8b5074cf3e6248668995f266845c8969", "adminURL": "http://10.222.0.32:8080"}]}] May 30 12:10:21.587043 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Tenant: tempest-AttachVolumeTestJSON-836453923 May 30 12:10:21.587043 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Tenant-Id: 8b5074cf3e6248668995f266845c8969 May 30 12:10:21.587043 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Tenant-Name: tempest-AttachVolumeTestJSON-836453923 May 30 12:10:21.587043 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User: tempest-AttachVolumeTestJSON-836453923-project May 30 12:10:21.587043 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Domain-Id: default May 30 12:10:21.587043 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Domain-Name: Default May 30 12:10:21.587043 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Id: c76e8d7bfdc04ea79c83ca7fb6b9ade1 May 30 12:10:21.587043 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Name: tempest-AttachVolumeTestJSON-836453923-project May 30 12:10:21.587043 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: method: > May 30 12:10:21.587043 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: exception: Instance 9c81cc0f-7430-4246-a05e-4670433f04ac could not be found. May 30 12:10:21.587043 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: action_args: {'id': '9c81cc0f-7430-4246-a05e-4670433f04ac'} May 30 12:10:21.588389 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:10:21.588389 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:10:21.588389 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:10:21.588389 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:10:21.588389 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:10:21.588389 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:10:21.588389 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:10:21.588389 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:10:21.588389 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:10:21.588389 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:10:21.588389 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c81cc0f-7430-4246-a05e-4670433f04ac could not be found. May 30 12:10:21.588389 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:10:21.588389 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:10:21.588389 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:10:21.588389 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:10:21.588389 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:10:21.588389 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:10:21.588389 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:10:21.588389 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:10:21.588389 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:10:21.590685 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:10:21.590685 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 30 12:10:21.590685 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 30 12:10:21.590685 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 30 12:10:21.590685 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 30 12:10:21.590685 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:10:21.590685 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:10:21.590685 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c81cc0f-7430-4246-a05e-4670433f04ac could not be found. May 30 12:10:21.590685 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:10:21.590685 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:10:21.590685 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:10:21.590685 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:10:21.590685 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:10:21.590685 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:10:21.590685 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:10:21.590685 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:10:21.590685 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c81cc0f-7430-4246-a05e-4670433f04ac could not be found. May 30 12:10:21.590685 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:10:21.591982 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-f8aaa65a-2082-42dc-8a86-88222e912ca8 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Returning 404 to user: Instance 9c81cc0f-7430-4246-a05e-4670433f04ac could not be found. {{(pid=117671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:10:21.591982 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-f8aaa65a-2082-42dc-8a86-88222e912ca8 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/9c81cc0f-7430-4246-a05e-4670433f04ac" status: 404 len: 111 microversion: 2.1 time: 0.034870 May 30 12:10:21.591982 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 396/779] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:10:21 2022] GET /compute/v2.1/servers/9c81cc0f-7430-4246-a05e-4670433f04ac => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 30 12:10:22.365935 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-71312640-902a-468b-8d09-d3a6d6a6c9e6 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:22.366547 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-71312640-902a-468b-8d09-d3a6d6a6c9e6 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:22.372886 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-71312640-902a-468b-8d09-d3a6d6a6c9e6 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:22.373348 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-71312640-902a-468b-8d09-d3a6d6a6c9e6 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:22.374670 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-71312640-902a-468b-8d09-d3a6d6a6c9e6 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:22.374670 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-71312640-902a-468b-8d09-d3a6d6a6c9e6 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:22.522233 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-71312640-902a-468b-8d09-d3a6d6a6c9e6 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:22.532139 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-71312640-902a-468b-8d09-d3a6d6a6c9e6 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:22.533777 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-71312640-902a-468b-8d09-d3a6d6a6c9e6 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:22.535098 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-71312640-902a-468b-8d09-d3a6d6a6c9e6 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c" status: 200 len: 1663 microversion: 2.20 time: 0.172990 May 30 12:10:22.535979 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 384/780] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:10:22 2022] GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c => generated 1663 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:10:22.556816 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-f7456eae-20d4-48e3-83d3-02192657082c tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d5dbc57b-4266-4874-ba5c-cdd248602e7c"}} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:10:22.558525 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-f7456eae-20d4-48e3-83d3-02192657082c tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:22.566694 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f7456eae-20d4-48e3-83d3-02192657082c tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:22.566694 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f7456eae-20d4-48e3-83d3-02192657082c tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:22.567445 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f7456eae-20d4-48e3-83d3-02192657082c tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:22.568188 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f7456eae-20d4-48e3-83d3-02192657082c tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:22.748726 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-89febf08-b6c4-42ed-a05e-76e26bf89a92 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:22.749501 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-89febf08-b6c4-42ed-a05e-76e26bf89a92 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 08b1b860-516e-4041-8df8-1fa8cc65a4ed] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:22.756993 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-89febf08-b6c4-42ed-a05e-76e26bf89a92 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:22.757675 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-89febf08-b6c4-42ed-a05e-76e26bf89a92 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:22.758990 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-89febf08-b6c4-42ed-a05e-76e26bf89a92 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:22.759435 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-89febf08-b6c4-42ed-a05e-76e26bf89a92 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:22.777916 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.wsgi [None req-89febf08-b6c4-42ed-a05e-76e26bf89a92 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] HTTP exception thrown: Instance 08b1b860-516e-4041-8df8-1fa8cc65a4ed could not be found. May 30 12:10:22.779912 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-89febf08-b6c4-42ed-a05e-76e26bf89a92 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Request method failure captured: May 30 12:10:22.779912 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: request: DELETE /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed HTTP/1.1 May 30 12:10:22.779912 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Accept: application/json May 30 12:10:22.779912 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Accept-Encoding: identity May 30 12:10:22.779912 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Connection: close May 30 12:10:22.779912 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Content-Length: 0 May 30 12:10:22.779912 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Content-Type: application/json May 30 12:10:22.779912 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Host: 10.222.0.32 May 30 12:10:22.779912 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Openstack-System-Scope: None May 30 12:10:22.779912 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: User-Agent: python-urllib3/1.26.9 May 30 12:10:22.779912 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Auth-Token: gAAAAABilLK4IddkunCo0Xmjrms8ofv8_gpbvwTsl-mso90Gd-x4mCJoeDTHM6sXVesnqNGpnDpFAQG8d_YdpsH3sRAOPyTza0DMw9keL1RdMfuWo3t12sQTo4M7obVAI5TL8y9jPYTTnwfsh-ZnAj255hOWPH4AJlfv00aeUv7tlc7kqVzUCJk May 30 12:10:22.779912 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Domain-Id: None May 30 12:10:22.779912 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Domain-Name: None May 30 12:10:22.779912 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Identity-Status: Confirmed May 30 12:10:22.779912 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Is-Admin-Project: True May 30 12:10:22.779912 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Domain-Id: default May 30 12:10:22.779912 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Domain-Name: Default May 30 12:10:22.779912 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Id: 8b5074cf3e6248668995f266845c8969 May 30 12:10:22.779912 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Name: tempest-AttachVolumeTestJSON-836453923 May 30 12:10:22.779912 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Role: reader,member May 30 12:10:22.779912 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Roles: reader,member May 30 12:10:22.781524 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/8b5074cf3e6248668995f266845c8969"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/8b5074cf3e6248668995f266845c8969"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/8b5074cf3e6248668995f266845c8969"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_8b5074cf3e6248668995f266845c8969", "adminURL": "http://10.222.0.32:8080"}]}] May 30 12:10:22.781524 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant: tempest-AttachVolumeTestJSON-836453923 May 30 12:10:22.781524 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant-Id: 8b5074cf3e6248668995f266845c8969 May 30 12:10:22.781524 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant-Name: tempest-AttachVolumeTestJSON-836453923 May 30 12:10:22.781524 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User: tempest-AttachVolumeTestJSON-836453923-project May 30 12:10:22.781524 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Domain-Id: default May 30 12:10:22.781524 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Domain-Name: Default May 30 12:10:22.781524 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Id: c76e8d7bfdc04ea79c83ca7fb6b9ade1 May 30 12:10:22.781524 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Name: tempest-AttachVolumeTestJSON-836453923-project May 30 12:10:22.781524 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: method: > May 30 12:10:22.781524 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: exception: Instance 08b1b860-516e-4041-8df8-1fa8cc65a4ed could not be found. May 30 12:10:22.781524 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: action_args: {'id': '08b1b860-516e-4041-8df8-1fa8cc65a4ed'} May 30 12:10:22.782613 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:10:22.782613 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:10:22.782613 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:10:22.782613 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:10:22.782613 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:10:22.782613 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:10:22.782613 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:10:22.782613 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:10:22.782613 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:10:22.782613 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:10:22.782613 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08b1b860-516e-4041-8df8-1fa8cc65a4ed could not be found. May 30 12:10:22.782613 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:10:22.782613 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:10:22.782613 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:10:22.782613 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:10:22.782613 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:10:22.782613 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:10:22.782613 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:10:22.782613 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:10:22.782613 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:10:22.784036 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:10:22.784036 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 30 12:10:22.784036 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 30 12:10:22.784036 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 30 12:10:22.784036 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 30 12:10:22.784036 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 30 12:10:22.784036 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 30 12:10:22.784036 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:10:22.784036 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:10:22.784036 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08b1b860-516e-4041-8df8-1fa8cc65a4ed could not be found. May 30 12:10:22.784036 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:10:22.784036 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:10:22.784036 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:10:22.784036 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:10:22.784036 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:10:22.784036 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:10:22.784036 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:10:22.784036 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:10:22.784036 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08b1b860-516e-4041-8df8-1fa8cc65a4ed could not be found. May 30 12:10:22.784036 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:10:22.786079 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-89febf08-b6c4-42ed-a05e-76e26bf89a92 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Returning 404 to user: Instance 08b1b860-516e-4041-8df8-1fa8cc65a4ed could not be found. {{(pid=117670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:10:22.786079 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-89febf08-b6c4-42ed-a05e-76e26bf89a92 tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "DELETE /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed" status: 404 len: 111 microversion: 2.1 time: 0.037238 May 30 12:10:22.786079 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 385/781] 10.222.0.32 () {58 vars in 1238 bytes} [Mon May 30 12:10:22 2022] DELETE /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 30 12:10:22.794119 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-38f6be68-f295-4e97-b24a-b95f394b244d tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:22.794749 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-38f6be68-f295-4e97-b24a-b95f394b244d tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] [instance: 08b1b860-516e-4041-8df8-1fa8cc65a4ed] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:22.802110 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-38f6be68-f295-4e97-b24a-b95f394b244d tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:22.802610 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-38f6be68-f295-4e97-b24a-b95f394b244d tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:22.803528 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-38f6be68-f295-4e97-b24a-b95f394b244d tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:22.803973 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-38f6be68-f295-4e97-b24a-b95f394b244d tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:22.820087 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.wsgi [None req-38f6be68-f295-4e97-b24a-b95f394b244d tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] HTTP exception thrown: Instance 08b1b860-516e-4041-8df8-1fa8cc65a4ed could not be found. May 30 12:10:22.822413 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-38f6be68-f295-4e97-b24a-b95f394b244d tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Request method failure captured: May 30 12:10:22.822413 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: request: GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed HTTP/1.1 May 30 12:10:22.822413 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Accept: application/json May 30 12:10:22.822413 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Accept-Encoding: identity May 30 12:10:22.822413 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Connection: close May 30 12:10:22.822413 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Content-Length: 0 May 30 12:10:22.822413 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Content-Type: application/json May 30 12:10:22.822413 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Host: 10.222.0.32 May 30 12:10:22.822413 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Openstack-System-Scope: None May 30 12:10:22.822413 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: User-Agent: python-urllib3/1.26.9 May 30 12:10:22.822413 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Auth-Token: gAAAAABilLK4IddkunCo0Xmjrms8ofv8_gpbvwTsl-mso90Gd-x4mCJoeDTHM6sXVesnqNGpnDpFAQG8d_YdpsH3sRAOPyTza0DMw9keL1RdMfuWo3t12sQTo4M7obVAI5TL8y9jPYTTnwfsh-ZnAj255hOWPH4AJlfv00aeUv7tlc7kqVzUCJk May 30 12:10:22.822413 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Domain-Id: None May 30 12:10:22.822413 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Domain-Name: None May 30 12:10:22.822413 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Identity-Status: Confirmed May 30 12:10:22.822413 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Is-Admin-Project: True May 30 12:10:22.822413 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Domain-Id: default May 30 12:10:22.822413 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Domain-Name: Default May 30 12:10:22.822413 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Id: 8b5074cf3e6248668995f266845c8969 May 30 12:10:22.822413 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Name: tempest-AttachVolumeTestJSON-836453923 May 30 12:10:22.822413 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Role: reader,member May 30 12:10:22.822413 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Roles: reader,member May 30 12:10:22.825138 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/8b5074cf3e6248668995f266845c8969"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/8b5074cf3e6248668995f266845c8969"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/8b5074cf3e6248668995f266845c8969"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_8b5074cf3e6248668995f266845c8969", "adminURL": "http://10.222.0.32:8080"}]}] May 30 12:10:22.825138 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant: tempest-AttachVolumeTestJSON-836453923 May 30 12:10:22.825138 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant-Id: 8b5074cf3e6248668995f266845c8969 May 30 12:10:22.825138 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant-Name: tempest-AttachVolumeTestJSON-836453923 May 30 12:10:22.825138 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User: tempest-AttachVolumeTestJSON-836453923-project May 30 12:10:22.825138 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Domain-Id: default May 30 12:10:22.825138 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Domain-Name: Default May 30 12:10:22.825138 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Id: c76e8d7bfdc04ea79c83ca7fb6b9ade1 May 30 12:10:22.825138 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Name: tempest-AttachVolumeTestJSON-836453923-project May 30 12:10:22.825138 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: method: > May 30 12:10:22.825138 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: exception: Instance 08b1b860-516e-4041-8df8-1fa8cc65a4ed could not be found. May 30 12:10:22.825138 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: action_args: {'id': '08b1b860-516e-4041-8df8-1fa8cc65a4ed'} May 30 12:10:22.826037 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:10:22.826037 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:10:22.826037 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:10:22.826037 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:10:22.826037 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:10:22.826037 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:10:22.826037 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:10:22.826037 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:10:22.826037 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:10:22.826037 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:10:22.826037 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08b1b860-516e-4041-8df8-1fa8cc65a4ed could not be found. May 30 12:10:22.826037 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:10:22.826037 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:10:22.826037 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:10:22.826037 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:10:22.826037 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:10:22.826037 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:10:22.826037 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:10:22.826037 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:10:22.826037 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:10:22.827619 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:10:22.827619 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 30 12:10:22.827619 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 30 12:10:22.827619 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 30 12:10:22.827619 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 30 12:10:22.827619 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:10:22.827619 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:10:22.827619 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08b1b860-516e-4041-8df8-1fa8cc65a4ed could not be found. May 30 12:10:22.827619 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:10:22.827619 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:10:22.827619 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:10:22.827619 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:10:22.827619 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:10:22.827619 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:10:22.827619 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:10:22.827619 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:10:22.827619 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08b1b860-516e-4041-8df8-1fa8cc65a4ed could not be found. May 30 12:10:22.827619 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:10:22.829419 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-38f6be68-f295-4e97-b24a-b95f394b244d tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] Returning 404 to user: Instance 08b1b860-516e-4041-8df8-1fa8cc65a4ed could not be found. {{(pid=117670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:10:22.829419 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-38f6be68-f295-4e97-b24a-b95f394b244d tempest-AttachVolumeTestJSON-836453923 tempest-AttachVolumeTestJSON-836453923-project] 10.222.0.32 "GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed" status: 404 len: 111 microversion: 2.1 time: 0.036055 May 30 12:10:22.829419 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 386/782] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:10:22 2022] GET /compute/v2.1/servers/08b1b860-516e-4041-8df8-1fa8cc65a4ed => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 30 12:10:22.935189 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-f7456eae-20d4-48e3-83d3-02192657082c tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "POST /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.382781 May 30 12:10:22.936834 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 397/783] 10.222.0.32 () {62 vars in 1363 bytes} [Mon May 30 12:10:22 2022] POST /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c/os-volume_attachments => generated 188 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 30 12:10:23.097334 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-265ebeef-7856-4e1b-83de-a9b1646b345d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:23.098267 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-265ebeef-7856-4e1b-83de-a9b1646b345d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:23.104760 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-265ebeef-7856-4e1b-83de-a9b1646b345d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:23.106050 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-265ebeef-7856-4e1b-83de-a9b1646b345d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:23.106851 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-265ebeef-7856-4e1b-83de-a9b1646b345d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:23.107789 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-265ebeef-7856-4e1b-83de-a9b1646b345d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:23.432284 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-265ebeef-7856-4e1b-83de-a9b1646b345d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "DELETE /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c/os-volume_attachments/d5dbc57b-4266-4874-ba5c-cdd248602e7c" status: 202 len: 0 microversion: 2.20 time: 0.343070 May 30 12:10:23.432971 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 387/784] 10.222.0.32 () {60 vars in 1456 bytes} [Mon May 30 12:10:23 2022] DELETE /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c/os-volume_attachments/d5dbc57b-4266-4874-ba5c-cdd248602e7c => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 30 12:10:23.495023 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-4636db13-3670-489c-829e-d1a9b66f69f2 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:10:23.496332 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-4636db13-3670-489c-829e-d1a9b66f69f2 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:23.507376 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4636db13-3670-489c-829e-d1a9b66f69f2 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:23.508313 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4636db13-3670-489c-829e-d1a9b66f69f2 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:23.509957 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4636db13-3670-489c-829e-d1a9b66f69f2 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:23.510748 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4636db13-3670-489c-829e-d1a9b66f69f2 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:23.599110 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-4636db13-3670-489c-829e-d1a9b66f69f2 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "POST /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c/action" status: 202 len: 0 microversion: 2.20 time: 0.109033 May 30 12:10:23.603065 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 398/785] 10.222.0.32 () {62 vars in 1318 bytes} [Mon May 30 12:10:23 2022] POST /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 30 12:10:23.608765 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-efd8943f-dfd3-485c-8e3c-d9151c752ea1 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:23.609217 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-efd8943f-dfd3-485c-8e3c-d9151c752ea1 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:23.616473 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-efd8943f-dfd3-485c-8e3c-d9151c752ea1 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:23.617249 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-efd8943f-dfd3-485c-8e3c-d9151c752ea1 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:23.618272 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-efd8943f-dfd3-485c-8e3c-d9151c752ea1 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:23.618941 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-efd8943f-dfd3-485c-8e3c-d9151c752ea1 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:23.762728 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-efd8943f-dfd3-485c-8e3c-d9151c752ea1 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:23.772575 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-efd8943f-dfd3-485c-8e3c-d9151c752ea1 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:23.774217 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-efd8943f-dfd3-485c-8e3c-d9151c752ea1 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:23.775490 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-efd8943f-dfd3-485c-8e3c-d9151c752ea1 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c" status: 200 len: 1671 microversion: 2.20 time: 0.171206 May 30 12:10:23.776124 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 388/786] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:10:23 2022] GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c => generated 1671 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:10:24.142846 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-75432bbb-15de-4937-94a5-5fc9dddf77da req-62f7bc2c-c521-4818-bdcf-ff6df56c4e73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0614f5df-431f-4955-acdb-05894441016c", "name": "network-vif-unplugged", "status": "completed", "tag": "e2714e9d-b17a-42e1-8920-55a988a1b563"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:10:24.155967 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-75432bbb-15de-4937-94a5-5fc9dddf77da req-62f7bc2c-c521-4818-bdcf-ff6df56c4e73 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:24.156646 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-75432bbb-15de-4937-94a5-5fc9dddf77da req-62f7bc2c-c521-4818-bdcf-ff6df56c4e73 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:24.180380 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.compute.server_external_events [req-75432bbb-15de-4937-94a5-5fc9dddf77da req-62f7bc2c-c521-4818-bdcf-ff6df56c4e73 service nova] Unable to find a host for instance 0614f5df-431f-4955-acdb-05894441016c. Dropping event network-vif-unplugged {{(pid=117671) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 30 12:10:24.182195 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-75432bbb-15de-4937-94a5-5fc9dddf77da req-62f7bc2c-c521-4818-bdcf-ff6df56c4e73 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.045430 May 30 12:10:24.183280 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 399/787] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:10:24 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 48 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 30 12:10:24.794159 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-cdeaf1c1-07b5-4450-b822-bd8c40cd6d4e tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:24.794803 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-cdeaf1c1-07b5-4450-b822-bd8c40cd6d4e tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:24.802732 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-cdeaf1c1-07b5-4450-b822-bd8c40cd6d4e tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:24.803362 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-cdeaf1c1-07b5-4450-b822-bd8c40cd6d4e tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:24.804321 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-cdeaf1c1-07b5-4450-b822-bd8c40cd6d4e tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:24.804911 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-cdeaf1c1-07b5-4450-b822-bd8c40cd6d4e tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:24.944666 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-cdeaf1c1-07b5-4450-b822-bd8c40cd6d4e tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:24.952898 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-cdeaf1c1-07b5-4450-b822-bd8c40cd6d4e tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:24.954397 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-cdeaf1c1-07b5-4450-b822-bd8c40cd6d4e tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:24.955560 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-cdeaf1c1-07b5-4450-b822-bd8c40cd6d4e tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c" status: 200 len: 1729 microversion: 2.20 time: 0.165613 May 30 12:10:24.956384 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 389/788] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:10:24 2022] GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:10:25.985597 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-13f6269e-cb33-4735-ba6f-2e22bbaee0c1 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:25.986233 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-13f6269e-cb33-4735-ba6f-2e22bbaee0c1 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:26.002040 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-13f6269e-cb33-4735-ba6f-2e22bbaee0c1 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:26.002811 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-13f6269e-cb33-4735-ba6f-2e22bbaee0c1 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:26.003773 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-13f6269e-cb33-4735-ba6f-2e22bbaee0c1 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:26.005937 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-13f6269e-cb33-4735-ba6f-2e22bbaee0c1 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:26.173517 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-13f6269e-cb33-4735-ba6f-2e22bbaee0c1 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:26.185318 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-13f6269e-cb33-4735-ba6f-2e22bbaee0c1 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:26.186851 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-13f6269e-cb33-4735-ba6f-2e22bbaee0c1 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:26.188521 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-13f6269e-cb33-4735-ba6f-2e22bbaee0c1 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c" status: 200 len: 1729 microversion: 2.20 time: 0.215622 May 30 12:10:26.189292 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 400/789] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:10:25 2022] GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c => generated 1729 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:10:27.216728 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-9eb004d7-0221-400d-9717-2c8dc23e66c1 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:27.217482 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-9eb004d7-0221-400d-9717-2c8dc23e66c1 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:27.225560 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_api:SELECT=59,nova_api:DELETE=1 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:10:27.239871 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9eb004d7-0221-400d-9717-2c8dc23e66c1 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:27.243067 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9eb004d7-0221-400d-9717-2c8dc23e66c1 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:27.246841 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9eb004d7-0221-400d-9717-2c8dc23e66c1 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:27.248130 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9eb004d7-0221-400d-9717-2c8dc23e66c1 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:27.545725 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-9eb004d7-0221-400d-9717-2c8dc23e66c1 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:27.555292 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-9eb004d7-0221-400d-9717-2c8dc23e66c1 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:27.557456 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-9eb004d7-0221-400d-9717-2c8dc23e66c1 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:27.559195 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-9eb004d7-0221-400d-9717-2c8dc23e66c1 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c" status: 200 len: 1729 microversion: 2.20 time: 0.354503 May 30 12:10:27.559919 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 390/790] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:10:27 2022] GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c => generated 1729 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:10:28.581232 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-1aca922b-ee03-482d-9a9b-a54030acf7c0 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:28.581843 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-1aca922b-ee03-482d-9a9b-a54030acf7c0 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:28.588951 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1aca922b-ee03-482d-9a9b-a54030acf7c0 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:28.589707 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1aca922b-ee03-482d-9a9b-a54030acf7c0 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:28.590690 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1aca922b-ee03-482d-9a9b-a54030acf7c0 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:28.591536 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1aca922b-ee03-482d-9a9b-a54030acf7c0 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:28.783281 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-1aca922b-ee03-482d-9a9b-a54030acf7c0 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:28.793379 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-1aca922b-ee03-482d-9a9b-a54030acf7c0 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:28.795090 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-1aca922b-ee03-482d-9a9b-a54030acf7c0 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:28.802660 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-1aca922b-ee03-482d-9a9b-a54030acf7c0 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c" status: 200 len: 1729 microversion: 2.20 time: 0.228149 May 30 12:10:28.806235 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 401/791] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:10:28 2022] GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c => generated 1729 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 30 12:10:29.823733 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-cd892f6b-0f3c-442d-97b0-d6e98258d5c8 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:29.824430 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-cd892f6b-0f3c-442d-97b0-d6e98258d5c8 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:29.831798 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-cd892f6b-0f3c-442d-97b0-d6e98258d5c8 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:29.836292 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-cd892f6b-0f3c-442d-97b0-d6e98258d5c8 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:29.837635 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-cd892f6b-0f3c-442d-97b0-d6e98258d5c8 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:29.838059 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-cd892f6b-0f3c-442d-97b0-d6e98258d5c8 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:30.071300 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-cd892f6b-0f3c-442d-97b0-d6e98258d5c8 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:30.080246 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-cd892f6b-0f3c-442d-97b0-d6e98258d5c8 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:30.081767 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-cd892f6b-0f3c-442d-97b0-d6e98258d5c8 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:30.083396 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-cd892f6b-0f3c-442d-97b0-d6e98258d5c8 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c" status: 200 len: 1729 microversion: 2.20 time: 0.263601 May 30 12:10:30.093519 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 391/792] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:10:29 2022] GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c => generated 1729 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:10:31.102796 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-fdfb44c8-d3f8-4050-a170-91a1a2258149 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:31.104092 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-fdfb44c8-d3f8-4050-a170-91a1a2258149 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:31.112870 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-fdfb44c8-d3f8-4050-a170-91a1a2258149 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:31.114006 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-fdfb44c8-d3f8-4050-a170-91a1a2258149 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:31.115313 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-fdfb44c8-d3f8-4050-a170-91a1a2258149 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:31.115976 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-fdfb44c8-d3f8-4050-a170-91a1a2258149 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:31.367788 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-fdfb44c8-d3f8-4050-a170-91a1a2258149 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:31.377824 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-fdfb44c8-d3f8-4050-a170-91a1a2258149 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:31.384547 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-fdfb44c8-d3f8-4050-a170-91a1a2258149 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:31.387148 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-fdfb44c8-d3f8-4050-a170-91a1a2258149 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c" status: 200 len: 1729 microversion: 2.20 time: 0.289196 May 30 12:10:31.395561 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 402/793] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:10:31 2022] GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c => generated 1729 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:10:32.417264 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-fb31be7b-01af-4de7-821f-37eb6b020f44 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:32.418198 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-fb31be7b-01af-4de7-821f-37eb6b020f44 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:32.431593 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-fb31be7b-01af-4de7-821f-37eb6b020f44 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:32.432144 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-fb31be7b-01af-4de7-821f-37eb6b020f44 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:32.432997 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-fb31be7b-01af-4de7-821f-37eb6b020f44 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:32.433432 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-fb31be7b-01af-4de7-821f-37eb6b020f44 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:32.608850 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-fb31be7b-01af-4de7-821f-37eb6b020f44 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:32.617889 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-fb31be7b-01af-4de7-821f-37eb6b020f44 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:32.619394 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-fb31be7b-01af-4de7-821f-37eb6b020f44 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:32.620596 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-fb31be7b-01af-4de7-821f-37eb6b020f44 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c" status: 200 len: 1729 microversion: 2.20 time: 0.207236 May 30 12:10:32.621206 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 392/794] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:10:32 2022] GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c => generated 1729 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:10:33.639456 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-7486411f-1038-435d-8cd5-8662f30ee0cc tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:33.640084 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-7486411f-1038-435d-8cd5-8662f30ee0cc tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:33.658386 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7486411f-1038-435d-8cd5-8662f30ee0cc tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:33.659031 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7486411f-1038-435d-8cd5-8662f30ee0cc tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:33.660065 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7486411f-1038-435d-8cd5-8662f30ee0cc tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:33.660684 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7486411f-1038-435d-8cd5-8662f30ee0cc tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:33.906010 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-7486411f-1038-435d-8cd5-8662f30ee0cc tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:33.919063 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-7486411f-1038-435d-8cd5-8662f30ee0cc tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:33.922942 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-7486411f-1038-435d-8cd5-8662f30ee0cc tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:33.925145 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-7486411f-1038-435d-8cd5-8662f30ee0cc tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c" status: 200 len: 1729 microversion: 2.20 time: 0.289634 May 30 12:10:33.926585 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 403/795] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:10:33 2022] GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c => generated 1729 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:10:34.563368 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-c17c36ac-dee8-437e-acc8-aa6ed1d1d2d6 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:34.563921 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-c17c36ac-dee8-437e-acc8-aa6ed1d1d2d6 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: fb448f70-fb3f-4cc2-861d-941a7995e4bc] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:34.571145 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c17c36ac-dee8-437e-acc8-aa6ed1d1d2d6 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:34.571564 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c17c36ac-dee8-437e-acc8-aa6ed1d1d2d6 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:34.572701 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c17c36ac-dee8-437e-acc8-aa6ed1d1d2d6 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:34.573142 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c17c36ac-dee8-437e-acc8-aa6ed1d1d2d6 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:34.606785 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-c17c36ac-dee8-437e-acc8-aa6ed1d1d2d6 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/fb448f70-fb3f-4cc2-861d-941a7995e4bc/ips" status: 200 len: 149 microversion: 2.1 time: 0.047271 May 30 12:10:34.613720 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 393/796] 10.222.0.32 () {58 vars in 1247 bytes} [Mon May 30 12:10:34 2022] GET /compute/v2.1/servers/fb448f70-fb3f-4cc2-861d-941a7995e4bc/ips => generated 149 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:10:34.965384 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-1359d8cb-7fa4-4336-aae5-96d12b72223d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:34.965899 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-1359d8cb-7fa4-4336-aae5-96d12b72223d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:34.973913 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1359d8cb-7fa4-4336-aae5-96d12b72223d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:34.975144 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1359d8cb-7fa4-4336-aae5-96d12b72223d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:34.976586 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1359d8cb-7fa4-4336-aae5-96d12b72223d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:34.977203 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1359d8cb-7fa4-4336-aae5-96d12b72223d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:35.295962 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-1359d8cb-7fa4-4336-aae5-96d12b72223d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:35.306732 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-1359d8cb-7fa4-4336-aae5-96d12b72223d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:35.317453 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-1359d8cb-7fa4-4336-aae5-96d12b72223d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:35.321119 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-1359d8cb-7fa4-4336-aae5-96d12b72223d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c" status: 200 len: 1729 microversion: 2.20 time: 0.380086 May 30 12:10:35.321974 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 404/797] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:10:34 2022] GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c => generated 1729 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:10:36.177294 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-962e3f1e-d15f-4941-85d3-723ff569a3bc tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "119f667a-b623-434d-8e81-91b49bcde704"}} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:10:36.178833 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-962e3f1e-d15f-4941-85d3-723ff569a3bc tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: fb448f70-fb3f-4cc2-861d-941a7995e4bc] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:36.185670 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-962e3f1e-d15f-4941-85d3-723ff569a3bc tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:36.186513 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-962e3f1e-d15f-4941-85d3-723ff569a3bc tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:36.187144 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-962e3f1e-d15f-4941-85d3-723ff569a3bc tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:36.187580 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-962e3f1e-d15f-4941-85d3-723ff569a3bc tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:36.339255 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-f53bf2de-2e55-4a51-861f-8e5e8c759f02 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:36.339897 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-f53bf2de-2e55-4a51-861f-8e5e8c759f02 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:36.346901 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f53bf2de-2e55-4a51-861f-8e5e8c759f02 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:36.348034 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f53bf2de-2e55-4a51-861f-8e5e8c759f02 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:36.349114 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f53bf2de-2e55-4a51-861f-8e5e8c759f02 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:36.349573 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f53bf2de-2e55-4a51-861f-8e5e8c759f02 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:36.494833 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-f53bf2de-2e55-4a51-861f-8e5e8c759f02 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:36.507077 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-f53bf2de-2e55-4a51-861f-8e5e8c759f02 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:36.509140 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-f53bf2de-2e55-4a51-861f-8e5e8c759f02 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:36.510612 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-f53bf2de-2e55-4a51-861f-8e5e8c759f02 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c" status: 200 len: 1729 microversion: 2.20 time: 0.175276 May 30 12:10:36.511172 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 405/798] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:10:36 2022] GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c => generated 1729 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 30 12:10:37.529683 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-0c8204eb-67ce-4f20-92e3-21e2c6fc4eba tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:37.530436 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-0c8204eb-67ce-4f20-92e3-21e2c6fc4eba tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:37.537607 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0c8204eb-67ce-4f20-92e3-21e2c6fc4eba tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:37.538152 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0c8204eb-67ce-4f20-92e3-21e2c6fc4eba tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:37.538998 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0c8204eb-67ce-4f20-92e3-21e2c6fc4eba tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:37.539650 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0c8204eb-67ce-4f20-92e3-21e2c6fc4eba tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:37.601058 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=2,nova_cell1:UPDATE=5 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:10:37.628324 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-962e3f1e-d15f-4941-85d3-723ff569a3bc tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "POST /compute/v2.1/servers/fb448f70-fb3f-4cc2-861d-941a7995e4bc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.455743 May 30 12:10:37.630455 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 394/799] 10.222.0.32 () {60 vars in 1322 bytes} [Mon May 30 12:10:36 2022] POST /compute/v2.1/servers/fb448f70-fb3f-4cc2-861d-941a7995e4bc/os-volume_attachments => generated 194 bytes in 1459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:10:37.723253 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-0c8204eb-67ce-4f20-92e3-21e2c6fc4eba tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:37.732445 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-0c8204eb-67ce-4f20-92e3-21e2c6fc4eba tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:37.734103 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-0c8204eb-67ce-4f20-92e3-21e2c6fc4eba tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:37.735363 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-0c8204eb-67ce-4f20-92e3-21e2c6fc4eba tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c" status: 200 len: 1729 microversion: 2.20 time: 0.209552 May 30 12:10:37.746553 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 406/800] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:10:37 2022] GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c => generated 1729 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 30 12:10:38.756000 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-27504155-2b5f-4a07-a369-086cbb267d95 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:38.757440 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-27504155-2b5f-4a07-a369-086cbb267d95 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:38.763738 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-27504155-2b5f-4a07-a369-086cbb267d95 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:38.764232 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-27504155-2b5f-4a07-a369-086cbb267d95 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:38.765300 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-27504155-2b5f-4a07-a369-086cbb267d95 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:38.773621 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-27504155-2b5f-4a07-a369-086cbb267d95 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:38.918575 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-27504155-2b5f-4a07-a369-086cbb267d95 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:38.927421 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-27504155-2b5f-4a07-a369-086cbb267d95 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:38.928976 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-27504155-2b5f-4a07-a369-086cbb267d95 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:38.930189 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-27504155-2b5f-4a07-a369-086cbb267d95 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c" status: 200 len: 1729 microversion: 2.20 time: 0.180591 May 30 12:10:38.930975 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 395/801] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:10:38 2022] GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c => generated 1729 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 30 12:10:39.948954 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-eec3d2b6-7429-467c-8741-a2cfe5c86fe7 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:39.949687 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-eec3d2b6-7429-467c-8741-a2cfe5c86fe7 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:39.956913 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-eec3d2b6-7429-467c-8741-a2cfe5c86fe7 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:39.957476 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-eec3d2b6-7429-467c-8741-a2cfe5c86fe7 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:39.958454 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-eec3d2b6-7429-467c-8741-a2cfe5c86fe7 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:39.958890 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-eec3d2b6-7429-467c-8741-a2cfe5c86fe7 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:40.121920 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-eec3d2b6-7429-467c-8741-a2cfe5c86fe7 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:40.130582 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-eec3d2b6-7429-467c-8741-a2cfe5c86fe7 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:40.132607 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-eec3d2b6-7429-467c-8741-a2cfe5c86fe7 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:40.133782 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-eec3d2b6-7429-467c-8741-a2cfe5c86fe7 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c" status: 200 len: 1729 microversion: 2.20 time: 0.188979 May 30 12:10:40.134332 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 407/802] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:10:39 2022] GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c => generated 1729 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:10:41.152428 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-4f5e4233-230a-4015-8985-b9e7a05e2f3a tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:41.153074 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-4f5e4233-230a-4015-8985-b9e7a05e2f3a tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:41.159737 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4f5e4233-230a-4015-8985-b9e7a05e2f3a tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:41.160500 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4f5e4233-230a-4015-8985-b9e7a05e2f3a tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:41.161444 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4f5e4233-230a-4015-8985-b9e7a05e2f3a tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:41.161873 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4f5e4233-230a-4015-8985-b9e7a05e2f3a tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:41.312846 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-4f5e4233-230a-4015-8985-b9e7a05e2f3a tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:41.324286 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-4f5e4233-230a-4015-8985-b9e7a05e2f3a tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:41.325810 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-4f5e4233-230a-4015-8985-b9e7a05e2f3a tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:41.326984 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-4f5e4233-230a-4015-8985-b9e7a05e2f3a tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c" status: 200 len: 1729 microversion: 2.20 time: 0.178602 May 30 12:10:41.327549 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 396/803] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:10:41 2022] GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c => generated 1729 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:10:42.346001 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-8ba43362-66f9-4041-8077-54210b1c00ce tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:42.346767 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-8ba43362-66f9-4041-8077-54210b1c00ce tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:42.354769 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8ba43362-66f9-4041-8077-54210b1c00ce tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:42.355408 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8ba43362-66f9-4041-8077-54210b1c00ce tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:42.356363 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8ba43362-66f9-4041-8077-54210b1c00ce tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:42.356894 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8ba43362-66f9-4041-8077-54210b1c00ce tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:42.548746 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-d2172c9b-befc-40d9-8011-385a15511603 req-24cc7a38-9e46-44c0-a3d3-6c69b82fe0de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0614f5df-431f-4955-acdb-05894441016c", "name": "network-vif-plugged", "status": "completed", "tag": "e2714e9d-b17a-42e1-8920-55a988a1b563"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:10:42.558562 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-d2172c9b-befc-40d9-8011-385a15511603 req-24cc7a38-9e46-44c0-a3d3-6c69b82fe0de service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:42.560006 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-d2172c9b-befc-40d9-8011-385a15511603 req-24cc7a38-9e46-44c0-a3d3-6c69b82fe0de service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:42.576733 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-d2172c9b-befc-40d9-8011-385a15511603 req-24cc7a38-9e46-44c0-a3d3-6c69b82fe0de service nova] Creating event network-vif-plugged:e2714e9d-b17a-42e1-8920-55a988a1b563 for instance 0614f5df-431f-4955-acdb-05894441016c on hv-cinder-84051 May 30 12:10:42.583760 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-d2172c9b-befc-40d9-8011-385a15511603 req-24cc7a38-9e46-44c0-a3d3-6c69b82fe0de service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039436 May 30 12:10:42.584786 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 397/804] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:10:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 30 12:10:42.600872 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-8ba43362-66f9-4041-8077-54210b1c00ce tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:42.609553 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-8ba43362-66f9-4041-8077-54210b1c00ce tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:42.611085 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-8ba43362-66f9-4041-8077-54210b1c00ce tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:42.612546 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-8ba43362-66f9-4041-8077-54210b1c00ce tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c" status: 200 len: 1729 microversion: 2.20 time: 0.270522 May 30 12:10:42.613986 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 408/805] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:10:42 2022] GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c => generated 1729 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:10:43.634769 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-b732d2aa-8e41-4330-a1b6-7fb5c7f0b79b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:43.637332 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-b732d2aa-8e41-4330-a1b6-7fb5c7f0b79b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:43.647194 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b732d2aa-8e41-4330-a1b6-7fb5c7f0b79b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:43.648020 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b732d2aa-8e41-4330-a1b6-7fb5c7f0b79b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:43.649428 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b732d2aa-8e41-4330-a1b6-7fb5c7f0b79b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:43.650048 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b732d2aa-8e41-4330-a1b6-7fb5c7f0b79b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:43.942904 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-b732d2aa-8e41-4330-a1b6-7fb5c7f0b79b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:43.953394 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-b732d2aa-8e41-4330-a1b6-7fb5c7f0b79b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:43.955268 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-b732d2aa-8e41-4330-a1b6-7fb5c7f0b79b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:43.956748 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-b732d2aa-8e41-4330-a1b6-7fb5c7f0b79b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c" status: 200 len: 1729 microversion: 2.20 time: 0.328018 May 30 12:10:43.958157 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 398/806] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:10:43 2022] GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c => generated 1729 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:10:44.978407 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-95caeb0c-8077-436b-9666-274acf82a1cb tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:44.979280 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-95caeb0c-8077-436b-9666-274acf82a1cb tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:44.986614 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-95caeb0c-8077-436b-9666-274acf82a1cb tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:44.987287 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-95caeb0c-8077-436b-9666-274acf82a1cb tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:44.988886 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-95caeb0c-8077-436b-9666-274acf82a1cb tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:44.989979 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-95caeb0c-8077-436b-9666-274acf82a1cb tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:45.138354 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-95caeb0c-8077-436b-9666-274acf82a1cb tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:45.141250 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:10:45.151165 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-95caeb0c-8077-436b-9666-274acf82a1cb tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:45.152841 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-95caeb0c-8077-436b-9666-274acf82a1cb tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:45.154746 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-95caeb0c-8077-436b-9666-274acf82a1cb tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c" status: 200 len: 1729 microversion: 2.20 time: 0.181434 May 30 12:10:45.155497 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 409/807] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:10:44 2022] GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c => generated 1729 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 30 12:10:45.398563 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-8bc2db01-e071-466d-8275-982f0598a483 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:45.399104 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-8bc2db01-e071-466d-8275-982f0598a483 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: fb448f70-fb3f-4cc2-861d-941a7995e4bc] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:45.405809 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8bc2db01-e071-466d-8275-982f0598a483 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:45.406268 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8bc2db01-e071-466d-8275-982f0598a483 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:45.407048 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8bc2db01-e071-466d-8275-982f0598a483 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:45.407491 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8bc2db01-e071-466d-8275-982f0598a483 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:45.495320 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.objects.instance [None req-8bc2db01-e071-466d-8275-982f0598a483 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lazy-loading 'services' on Instance uuid fb448f70-fb3f-4cc2-861d-941a7995e4bc {{(pid=117670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 30 12:10:45.568735 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-8bc2db01-e071-466d-8275-982f0598a483 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "DELETE /compute/v2.1/servers/fb448f70-fb3f-4cc2-861d-941a7995e4bc/os-volume_attachments/119f667a-b623-434d-8e81-91b49bcde704" status: 202 len: 0 microversion: 2.1 time: 0.173882 May 30 12:10:45.569521 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 399/808] 10.222.0.32 () {58 vars in 1415 bytes} [Mon May 30 12:10:45 2022] DELETE /compute/v2.1/servers/fb448f70-fb3f-4cc2-861d-941a7995e4bc/os-volume_attachments/119f667a-b623-434d-8e81-91b49bcde704 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 30 12:10:45.581753 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-77c771a6-907d-4903-b5b8-8dff9d7caef4 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:45.583039 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-77c771a6-907d-4903-b5b8-8dff9d7caef4 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: fb448f70-fb3f-4cc2-861d-941a7995e4bc] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:45.601903 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-77c771a6-907d-4903-b5b8-8dff9d7caef4 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:45.602926 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-77c771a6-907d-4903-b5b8-8dff9d7caef4 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:45.604512 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-77c771a6-907d-4903-b5b8-8dff9d7caef4 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:45.604944 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-77c771a6-907d-4903-b5b8-8dff9d7caef4 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:45.638166 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-77c771a6-907d-4903-b5b8-8dff9d7caef4 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/fb448f70-fb3f-4cc2-861d-941a7995e4bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060328 May 30 12:10:45.638867 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 410/809] 10.222.0.32 () {58 vars in 1301 bytes} [Mon May 30 12:10:45 2022] GET /compute/v2.1/servers/fb448f70-fb3f-4cc2-861d-941a7995e4bc/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:10:46.177899 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-e7b63e9a-1a2c-41f3-9143-2bdf6819e453 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:46.178718 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-e7b63e9a-1a2c-41f3-9143-2bdf6819e453 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:46.186697 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e7b63e9a-1a2c-41f3-9143-2bdf6819e453 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:46.187158 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e7b63e9a-1a2c-41f3-9143-2bdf6819e453 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:46.188094 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e7b63e9a-1a2c-41f3-9143-2bdf6819e453 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:46.188568 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e7b63e9a-1a2c-41f3-9143-2bdf6819e453 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:46.410084 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-e7b63e9a-1a2c-41f3-9143-2bdf6819e453 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:46.428332 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-e7b63e9a-1a2c-41f3-9143-2bdf6819e453 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:46.432396 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-e7b63e9a-1a2c-41f3-9143-2bdf6819e453 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:46.434182 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-e7b63e9a-1a2c-41f3-9143-2bdf6819e453 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c" status: 200 len: 1716 microversion: 2.20 time: 0.261871 May 30 12:10:46.434935 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 400/810] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:10:46 2022] GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c => generated 1716 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:10:46.650725 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-e058711e-cdf8-46ab-b87b-59c521e89409 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:46.651743 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-e058711e-cdf8-46ab-b87b-59c521e89409 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: fb448f70-fb3f-4cc2-861d-941a7995e4bc] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:46.654147 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_api:SELECT=40 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:10:46.660263 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e058711e-cdf8-46ab-b87b-59c521e89409 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:46.660744 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e058711e-cdf8-46ab-b87b-59c521e89409 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:46.661545 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e058711e-cdf8-46ab-b87b-59c521e89409 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:46.662082 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e058711e-cdf8-46ab-b87b-59c521e89409 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:46.693117 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-e058711e-cdf8-46ab-b87b-59c521e89409 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/fb448f70-fb3f-4cc2-861d-941a7995e4bc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047022 May 30 12:10:46.693685 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 411/811] 10.222.0.32 () {58 vars in 1301 bytes} [Mon May 30 12:10:46 2022] GET /compute/v2.1/servers/fb448f70-fb3f-4cc2-861d-941a7995e4bc/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 30 12:10:46.754078 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-34aff72b-dbfd-4980-b1ef-c7ea3f05df78 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:46.754576 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-34aff72b-dbfd-4980-b1ef-c7ea3f05df78 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: fb448f70-fb3f-4cc2-861d-941a7995e4bc] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:46.760734 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-34aff72b-dbfd-4980-b1ef-c7ea3f05df78 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:46.761177 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-34aff72b-dbfd-4980-b1ef-c7ea3f05df78 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:46.762149 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-34aff72b-dbfd-4980-b1ef-c7ea3f05df78 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:46.762579 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-34aff72b-dbfd-4980-b1ef-c7ea3f05df78 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:46.797702 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-34aff72b-dbfd-4980-b1ef-c7ea3f05df78 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: fb448f70-fb3f-4cc2-861d-941a7995e4bc] Going to try to terminate instance {{(pid=117670) delete /opt/stack/nova/nova/compute/api.py:2664}} May 30 12:10:46.882573 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-34aff72b-dbfd-4980-b1ef-c7ea3f05df78 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "DELETE /compute/v2.1/servers/fb448f70-fb3f-4cc2-861d-941a7995e4bc" status: 204 len: 0 microversion: 2.1 time: 0.133121 May 30 12:10:46.883192 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 401/812] 10.222.0.32 () {58 vars in 1238 bytes} [Mon May 30 12:10:46 2022] DELETE /compute/v2.1/servers/fb448f70-fb3f-4cc2-861d-941a7995e4bc => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 30 12:10:46.891365 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-1d860cc5-258d-4edd-bdb3-d222d708188f tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:46.891982 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-1d860cc5-258d-4edd-bdb3-d222d708188f tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: fb448f70-fb3f-4cc2-861d-941a7995e4bc] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:46.898577 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1d860cc5-258d-4edd-bdb3-d222d708188f tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:46.899024 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1d860cc5-258d-4edd-bdb3-d222d708188f tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:46.899807 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1d860cc5-258d-4edd-bdb3-d222d708188f tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:46.900273 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1d860cc5-258d-4edd-bdb3-d222d708188f tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:47.039302 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-1d860cc5-258d-4edd-bdb3-d222d708188f tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7575179edbda45208561c983fc5b956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20763921c37c4e81bba702e09bf628b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:47.046942 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-1d860cc5-258d-4edd-bdb3-d222d708188f tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/fb448f70-fb3f-4cc2-861d-941a7995e4bc" status: 200 len: 1681 microversion: 2.1 time: 0.159497 May 30 12:10:47.047514 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 412/813] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:10:46 2022] GET /compute/v2.1/servers/fb448f70-fb3f-4cc2-861d-941a7995e4bc => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:10:48.065671 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-16b37c26-4932-400e-aa25-61178204fd98 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:48.066809 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-16b37c26-4932-400e-aa25-61178204fd98 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: fb448f70-fb3f-4cc2-861d-941a7995e4bc] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:48.074195 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-16b37c26-4932-400e-aa25-61178204fd98 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:48.074654 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-16b37c26-4932-400e-aa25-61178204fd98 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:48.075432 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-16b37c26-4932-400e-aa25-61178204fd98 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:48.075877 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-16b37c26-4932-400e-aa25-61178204fd98 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:48.324120 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-16b37c26-4932-400e-aa25-61178204fd98 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7575179edbda45208561c983fc5b956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20763921c37c4e81bba702e09bf628b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:48.332638 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-16b37c26-4932-400e-aa25-61178204fd98 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/fb448f70-fb3f-4cc2-861d-941a7995e4bc" status: 200 len: 1681 microversion: 2.1 time: 0.271631 May 30 12:10:48.342323 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 402/814] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:10:48 2022] GET /compute/v2.1/servers/fb448f70-fb3f-4cc2-861d-941a7995e4bc => generated 1681 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:10:49.350973 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-f76bb4f2-5543-47d3-a8ba-766a8c68b9e9 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:49.352229 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-f76bb4f2-5543-47d3-a8ba-766a8c68b9e9 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: fb448f70-fb3f-4cc2-861d-941a7995e4bc] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:49.358715 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f76bb4f2-5543-47d3-a8ba-766a8c68b9e9 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:49.359161 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f76bb4f2-5543-47d3-a8ba-766a8c68b9e9 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:49.360790 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f76bb4f2-5543-47d3-a8ba-766a8c68b9e9 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:49.361228 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f76bb4f2-5543-47d3-a8ba-766a8c68b9e9 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:49.625308 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-f76bb4f2-5543-47d3-a8ba-766a8c68b9e9 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7575179edbda45208561c983fc5b956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20763921c37c4e81bba702e09bf628b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:49.634850 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-f76bb4f2-5543-47d3-a8ba-766a8c68b9e9 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/fb448f70-fb3f-4cc2-861d-941a7995e4bc" status: 200 len: 1681 microversion: 2.1 time: 0.288621 May 30 12:10:49.635878 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 413/815] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:10:49 2022] GET /compute/v2.1/servers/fb448f70-fb3f-4cc2-861d-941a7995e4bc => generated 1681 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:10:49.877045 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-548118fd-2328-46cb-98df-fcc29c960b2b req-521c3a04-4f4f-47b2-b629-9469d92caff4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb448f70-fb3f-4cc2-861d-941a7995e4bc", "name": "network-vif-deleted", "tag": "39796ecd-611c-467e-94a4-897496e879ad"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:10:49.897922 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-548118fd-2328-46cb-98df-fcc29c960b2b req-521c3a04-4f4f-47b2-b629-9469d92caff4 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:49.902868 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-548118fd-2328-46cb-98df-fcc29c960b2b req-521c3a04-4f4f-47b2-b629-9469d92caff4 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:49.937264 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-548118fd-2328-46cb-98df-fcc29c960b2b req-521c3a04-4f4f-47b2-b629-9469d92caff4 service nova] Creating event network-vif-deleted:39796ecd-611c-467e-94a4-897496e879ad for instance fb448f70-fb3f-4cc2-861d-941a7995e4bc on hv-cinder-84051 May 30 12:10:49.954686 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-548118fd-2328-46cb-98df-fcc29c960b2b req-521c3a04-4f4f-47b2-b629-9469d92caff4 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081343 May 30 12:10:49.956279 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 403/816] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:10:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:10:50.653809 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-1a650982-d85d-40d9-84e6-8c677281310b tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:50.655292 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-1a650982-d85d-40d9-84e6-8c677281310b tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: fb448f70-fb3f-4cc2-861d-941a7995e4bc] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:50.665356 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1a650982-d85d-40d9-84e6-8c677281310b tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:50.666202 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1a650982-d85d-40d9-84e6-8c677281310b tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:50.667622 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1a650982-d85d-40d9-84e6-8c677281310b tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:50.668342 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1a650982-d85d-40d9-84e6-8c677281310b tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:50.686113 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.wsgi [None req-1a650982-d85d-40d9-84e6-8c677281310b tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] HTTP exception thrown: Instance fb448f70-fb3f-4cc2-861d-941a7995e4bc could not be found. May 30 12:10:50.688015 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-1a650982-d85d-40d9-84e6-8c677281310b tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Request method failure captured: May 30 12:10:50.688015 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: request: GET /compute/v2.1/servers/fb448f70-fb3f-4cc2-861d-941a7995e4bc HTTP/1.1 May 30 12:10:50.688015 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Accept: application/json May 30 12:10:50.688015 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Accept-Encoding: identity May 30 12:10:50.688015 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Connection: close May 30 12:10:50.688015 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Content-Length: 0 May 30 12:10:50.688015 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Content-Type: application/json May 30 12:10:50.688015 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Host: 10.222.0.32 May 30 12:10:50.688015 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Openstack-System-Scope: None May 30 12:10:50.688015 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: User-Agent: python-urllib3/1.26.9 May 30 12:10:50.688015 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Auth-Token: gAAAAABilLLAYcX6lTFc6UYhtte3qOfoT2D6p3xmrlj8lFSs8RM3SsxCJSweWMgYMCOyRE51N8YW3rSrU1JYG-ztTk5m_gEJkCNSzYatjS4LK9S2ataZ1OqgPb6zqIfN7SdtrBc2fQRHJMFEqwi_DhRkSGnSViHvbRwm6OQNgq1VdpWmApLUG3U May 30 12:10:50.688015 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Domain-Id: None May 30 12:10:50.688015 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Domain-Name: None May 30 12:10:50.688015 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Identity-Status: Confirmed May 30 12:10:50.688015 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Is-Admin-Project: True May 30 12:10:50.688015 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Domain-Id: default May 30 12:10:50.688015 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Domain-Name: Default May 30 12:10:50.688015 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Id: 20763921c37c4e81bba702e09bf628b2 May 30 12:10:50.688015 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Name: tempest-AttachVolumeNegativeTest-1368164951 May 30 12:10:50.688015 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Role: reader,member May 30 12:10:50.688015 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Roles: reader,member May 30 12:10:50.689658 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/20763921c37c4e81bba702e09bf628b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/20763921c37c4e81bba702e09bf628b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/20763921c37c4e81bba702e09bf628b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_20763921c37c4e81bba702e09bf628b2", "adminURL": "http://10.222.0.32:8080"}]}] May 30 12:10:50.689658 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Tenant: tempest-AttachVolumeNegativeTest-1368164951 May 30 12:10:50.689658 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Tenant-Id: 20763921c37c4e81bba702e09bf628b2 May 30 12:10:50.689658 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1368164951 May 30 12:10:50.689658 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User: tempest-AttachVolumeNegativeTest-1368164951-project May 30 12:10:50.689658 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Domain-Id: default May 30 12:10:50.689658 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Domain-Name: Default May 30 12:10:50.689658 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Id: 7575179edbda45208561c983fc5b956c May 30 12:10:50.689658 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Name: tempest-AttachVolumeNegativeTest-1368164951-project May 30 12:10:50.689658 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: method: > May 30 12:10:50.689658 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: exception: Instance fb448f70-fb3f-4cc2-861d-941a7995e4bc could not be found. May 30 12:10:50.689658 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: action_args: {'id': 'fb448f70-fb3f-4cc2-861d-941a7995e4bc'} May 30 12:10:50.691228 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:10:50.691228 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:10:50.691228 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:10:50.691228 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:10:50.691228 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:10:50.691228 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:10:50.691228 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:10:50.691228 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:10:50.691228 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:10:50.691228 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:10:50.691228 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb448f70-fb3f-4cc2-861d-941a7995e4bc could not be found. May 30 12:10:50.691228 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:10:50.691228 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:10:50.691228 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:10:50.691228 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:10:50.691228 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:10:50.691228 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:10:50.691228 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:10:50.691228 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:10:50.691228 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:10:50.692950 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:10:50.692950 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 30 12:10:50.692950 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 30 12:10:50.692950 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 30 12:10:50.692950 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 30 12:10:50.692950 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:10:50.692950 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:10:50.692950 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb448f70-fb3f-4cc2-861d-941a7995e4bc could not be found. May 30 12:10:50.692950 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:10:50.692950 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:10:50.692950 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:10:50.692950 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:10:50.692950 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:10:50.692950 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:10:50.692950 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:10:50.692950 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:10:50.692950 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb448f70-fb3f-4cc2-861d-941a7995e4bc could not be found. May 30 12:10:50.692950 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:10:50.694291 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-1a650982-d85d-40d9-84e6-8c677281310b tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Returning 404 to user: Instance fb448f70-fb3f-4cc2-861d-941a7995e4bc could not be found. {{(pid=117671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:10:50.694291 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-1a650982-d85d-40d9-84e6-8c677281310b tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/fb448f70-fb3f-4cc2-861d-941a7995e4bc" status: 404 len: 111 microversion: 2.1 time: 0.041026 May 30 12:10:50.694291 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 414/817] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:10:50 2022] GET /compute/v2.1/servers/fb448f70-fb3f-4cc2-861d-941a7995e4bc => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 30 12:10:50.701130 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-9bd114e1-c657-4026-9abe-88d0243b4294 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '.version_select at 0x7f0ef8a81670>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:50.726122 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-9bd114e1-c657-4026-9abe-88d0243b4294 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1202475036" status: 202 len: 0 microversion: 2.1 time: 0.030213 May 30 12:10:50.728741 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 404/818] 10.222.0.32 () {58 vars in 1220 bytes} [Mon May 30 12:10:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1202475036 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 30 12:10:52.807803 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-289db71e-6724-40f6-b06e-c82e72b7a9db tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:52.808403 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-289db71e-6724-40f6-b06e-c82e72b7a9db tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: fb448f70-fb3f-4cc2-861d-941a7995e4bc] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:52.816082 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-289db71e-6724-40f6-b06e-c82e72b7a9db tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:52.816928 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-289db71e-6724-40f6-b06e-c82e72b7a9db tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:52.817714 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-289db71e-6724-40f6-b06e-c82e72b7a9db tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:52.818152 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-289db71e-6724-40f6-b06e-c82e72b7a9db tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:52.835196 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.wsgi [None req-289db71e-6724-40f6-b06e-c82e72b7a9db tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] HTTP exception thrown: Instance fb448f70-fb3f-4cc2-861d-941a7995e4bc could not be found. May 30 12:10:52.838662 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-289db71e-6724-40f6-b06e-c82e72b7a9db tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Request method failure captured: May 30 12:10:52.838662 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: request: DELETE /compute/v2.1/servers/fb448f70-fb3f-4cc2-861d-941a7995e4bc HTTP/1.1 May 30 12:10:52.838662 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Accept: application/json May 30 12:10:52.838662 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Accept-Encoding: identity May 30 12:10:52.838662 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Connection: close May 30 12:10:52.838662 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Content-Length: 0 May 30 12:10:52.838662 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Content-Type: application/json May 30 12:10:52.838662 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Host: 10.222.0.32 May 30 12:10:52.838662 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Openstack-System-Scope: None May 30 12:10:52.838662 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: User-Agent: python-urllib3/1.26.9 May 30 12:10:52.838662 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Auth-Token: gAAAAABilLLAYcX6lTFc6UYhtte3qOfoT2D6p3xmrlj8lFSs8RM3SsxCJSweWMgYMCOyRE51N8YW3rSrU1JYG-ztTk5m_gEJkCNSzYatjS4LK9S2ataZ1OqgPb6zqIfN7SdtrBc2fQRHJMFEqwi_DhRkSGnSViHvbRwm6OQNgq1VdpWmApLUG3U May 30 12:10:52.838662 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Domain-Id: None May 30 12:10:52.838662 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Domain-Name: None May 30 12:10:52.838662 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Identity-Status: Confirmed May 30 12:10:52.838662 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Is-Admin-Project: True May 30 12:10:52.838662 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Domain-Id: default May 30 12:10:52.838662 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Domain-Name: Default May 30 12:10:52.838662 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Id: 20763921c37c4e81bba702e09bf628b2 May 30 12:10:52.838662 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Name: tempest-AttachVolumeNegativeTest-1368164951 May 30 12:10:52.838662 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Role: reader,member May 30 12:10:52.838662 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Roles: reader,member May 30 12:10:52.840345 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/20763921c37c4e81bba702e09bf628b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/20763921c37c4e81bba702e09bf628b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/20763921c37c4e81bba702e09bf628b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_20763921c37c4e81bba702e09bf628b2", "adminURL": "http://10.222.0.32:8080"}]}] May 30 12:10:52.840345 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Tenant: tempest-AttachVolumeNegativeTest-1368164951 May 30 12:10:52.840345 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Tenant-Id: 20763921c37c4e81bba702e09bf628b2 May 30 12:10:52.840345 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1368164951 May 30 12:10:52.840345 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User: tempest-AttachVolumeNegativeTest-1368164951-project May 30 12:10:52.840345 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Domain-Id: default May 30 12:10:52.840345 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Domain-Name: Default May 30 12:10:52.840345 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Id: 7575179edbda45208561c983fc5b956c May 30 12:10:52.840345 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Name: tempest-AttachVolumeNegativeTest-1368164951-project May 30 12:10:52.840345 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: method: > May 30 12:10:52.840345 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: exception: Instance fb448f70-fb3f-4cc2-861d-941a7995e4bc could not be found. May 30 12:10:52.840345 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: action_args: {'id': 'fb448f70-fb3f-4cc2-861d-941a7995e4bc'} May 30 12:10:52.841298 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:10:52.841298 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:10:52.841298 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:10:52.841298 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:10:52.841298 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:10:52.841298 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:10:52.841298 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:10:52.841298 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:10:52.841298 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:10:52.841298 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:10:52.841298 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb448f70-fb3f-4cc2-861d-941a7995e4bc could not be found. May 30 12:10:52.841298 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:10:52.841298 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:10:52.841298 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:10:52.841298 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:10:52.841298 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:10:52.841298 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:10:52.841298 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:10:52.841298 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:10:52.841298 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:10:52.842715 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:10:52.842715 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 30 12:10:52.842715 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 30 12:10:52.842715 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 30 12:10:52.842715 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 30 12:10:52.842715 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 30 12:10:52.842715 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 30 12:10:52.842715 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:10:52.842715 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:10:52.842715 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb448f70-fb3f-4cc2-861d-941a7995e4bc could not be found. May 30 12:10:52.842715 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:10:52.842715 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:10:52.842715 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:10:52.842715 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:10:52.842715 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:10:52.842715 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:10:52.842715 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:10:52.842715 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:10:52.842715 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb448f70-fb3f-4cc2-861d-941a7995e4bc could not be found. May 30 12:10:52.842715 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:10:52.844987 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-289db71e-6724-40f6-b06e-c82e72b7a9db tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Returning 404 to user: Instance fb448f70-fb3f-4cc2-861d-941a7995e4bc could not be found. {{(pid=117671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:10:52.845923 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-289db71e-6724-40f6-b06e-c82e72b7a9db tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "DELETE /compute/v2.1/servers/fb448f70-fb3f-4cc2-861d-941a7995e4bc" status: 404 len: 111 microversion: 2.1 time: 0.042156 May 30 12:10:52.850186 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 415/819] 10.222.0.32 () {58 vars in 1238 bytes} [Mon May 30 12:10:52 2022] DELETE /compute/v2.1/servers/fb448f70-fb3f-4cc2-861d-941a7995e4bc => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 30 12:10:52.863907 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-f130784e-9d08-4c56-b84c-a748d20698b2 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:52.864683 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-f130784e-9d08-4c56-b84c-a748d20698b2 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: fb448f70-fb3f-4cc2-861d-941a7995e4bc] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:52.871402 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f130784e-9d08-4c56-b84c-a748d20698b2 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:52.871972 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f130784e-9d08-4c56-b84c-a748d20698b2 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:52.872671 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f130784e-9d08-4c56-b84c-a748d20698b2 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:52.873296 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f130784e-9d08-4c56-b84c-a748d20698b2 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:52.891136 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.wsgi [None req-f130784e-9d08-4c56-b84c-a748d20698b2 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] HTTP exception thrown: Instance fb448f70-fb3f-4cc2-861d-941a7995e4bc could not be found. May 30 12:10:52.893500 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-f130784e-9d08-4c56-b84c-a748d20698b2 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Request method failure captured: May 30 12:10:52.893500 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: request: GET /compute/v2.1/servers/fb448f70-fb3f-4cc2-861d-941a7995e4bc HTTP/1.1 May 30 12:10:52.893500 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Accept: application/json May 30 12:10:52.893500 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Accept-Encoding: identity May 30 12:10:52.893500 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Connection: close May 30 12:10:52.893500 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Content-Length: 0 May 30 12:10:52.893500 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Content-Type: application/json May 30 12:10:52.893500 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Host: 10.222.0.32 May 30 12:10:52.893500 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Openstack-System-Scope: None May 30 12:10:52.893500 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: User-Agent: python-urllib3/1.26.9 May 30 12:10:52.893500 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Auth-Token: gAAAAABilLLAYcX6lTFc6UYhtte3qOfoT2D6p3xmrlj8lFSs8RM3SsxCJSweWMgYMCOyRE51N8YW3rSrU1JYG-ztTk5m_gEJkCNSzYatjS4LK9S2ataZ1OqgPb6zqIfN7SdtrBc2fQRHJMFEqwi_DhRkSGnSViHvbRwm6OQNgq1VdpWmApLUG3U May 30 12:10:52.893500 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Domain-Id: None May 30 12:10:52.893500 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Domain-Name: None May 30 12:10:52.893500 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Identity-Status: Confirmed May 30 12:10:52.893500 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Is-Admin-Project: True May 30 12:10:52.893500 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Domain-Id: default May 30 12:10:52.893500 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Domain-Name: Default May 30 12:10:52.893500 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Id: 20763921c37c4e81bba702e09bf628b2 May 30 12:10:52.893500 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Name: tempest-AttachVolumeNegativeTest-1368164951 May 30 12:10:52.893500 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Role: reader,member May 30 12:10:52.893500 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Roles: reader,member May 30 12:10:52.895079 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/20763921c37c4e81bba702e09bf628b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/20763921c37c4e81bba702e09bf628b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/20763921c37c4e81bba702e09bf628b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_20763921c37c4e81bba702e09bf628b2", "adminURL": "http://10.222.0.32:8080"}]}] May 30 12:10:52.895079 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant: tempest-AttachVolumeNegativeTest-1368164951 May 30 12:10:52.895079 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant-Id: 20763921c37c4e81bba702e09bf628b2 May 30 12:10:52.895079 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1368164951 May 30 12:10:52.895079 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User: tempest-AttachVolumeNegativeTest-1368164951-project May 30 12:10:52.895079 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Domain-Id: default May 30 12:10:52.895079 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Domain-Name: Default May 30 12:10:52.895079 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Id: 7575179edbda45208561c983fc5b956c May 30 12:10:52.895079 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Name: tempest-AttachVolumeNegativeTest-1368164951-project May 30 12:10:52.895079 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: method: > May 30 12:10:52.895079 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: exception: Instance fb448f70-fb3f-4cc2-861d-941a7995e4bc could not be found. May 30 12:10:52.895079 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: action_args: {'id': 'fb448f70-fb3f-4cc2-861d-941a7995e4bc'} May 30 12:10:52.896109 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:10:52.896109 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:10:52.896109 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:10:52.896109 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:10:52.896109 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:10:52.896109 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:10:52.896109 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:10:52.896109 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:10:52.896109 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:10:52.896109 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:10:52.896109 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb448f70-fb3f-4cc2-861d-941a7995e4bc could not be found. May 30 12:10:52.896109 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:10:52.896109 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:10:52.896109 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:10:52.896109 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:10:52.896109 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:10:52.896109 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:10:52.896109 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:10:52.896109 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:10:52.896109 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:10:52.897608 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:10:52.897608 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 30 12:10:52.897608 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 30 12:10:52.897608 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 30 12:10:52.897608 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 30 12:10:52.897608 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:10:52.897608 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:10:52.897608 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb448f70-fb3f-4cc2-861d-941a7995e4bc could not be found. May 30 12:10:52.897608 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:10:52.897608 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:10:52.897608 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:10:52.897608 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:10:52.897608 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:10:52.897608 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:10:52.897608 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:10:52.897608 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:10:52.897608 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb448f70-fb3f-4cc2-861d-941a7995e4bc could not be found. May 30 12:10:52.897608 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:10:52.898934 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-f130784e-9d08-4c56-b84c-a748d20698b2 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Returning 404 to user: Instance fb448f70-fb3f-4cc2-861d-941a7995e4bc could not be found. {{(pid=117670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:10:52.898934 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-f130784e-9d08-4c56-b84c-a748d20698b2 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/fb448f70-fb3f-4cc2-861d-941a7995e4bc" status: 404 len: 111 microversion: 2.1 time: 0.044027 May 30 12:10:52.898934 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 405/820] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:10:52 2022] GET /compute/v2.1/servers/fb448f70-fb3f-4cc2-861d-941a7995e4bc => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 30 12:10:54.069720 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-6cc62140-030c-4f8f-bfe5-37e7907d259b tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:54.070279 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-6cc62140-030c-4f8f-bfe5-37e7907d259b tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: ed036712-bf1c-4eaa-9736-b486dc1f76bf] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:54.077156 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-6cc62140-030c-4f8f-bfe5-37e7907d259b tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:54.077906 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-6cc62140-030c-4f8f-bfe5-37e7907d259b tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:54.078874 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-6cc62140-030c-4f8f-bfe5-37e7907d259b tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:54.079475 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-6cc62140-030c-4f8f-bfe5-37e7907d259b tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:54.094816 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.wsgi [None req-6cc62140-030c-4f8f-bfe5-37e7907d259b tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] HTTP exception thrown: Instance ed036712-bf1c-4eaa-9736-b486dc1f76bf could not be found. May 30 12:10:54.102555 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-6cc62140-030c-4f8f-bfe5-37e7907d259b tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Request method failure captured: May 30 12:10:54.102555 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: request: DELETE /compute/v2.1/servers/ed036712-bf1c-4eaa-9736-b486dc1f76bf HTTP/1.1 May 30 12:10:54.102555 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Accept: application/json May 30 12:10:54.102555 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Accept-Encoding: identity May 30 12:10:54.102555 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Connection: close May 30 12:10:54.102555 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Content-Length: 0 May 30 12:10:54.102555 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Content-Type: application/json May 30 12:10:54.102555 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Host: 10.222.0.32 May 30 12:10:54.102555 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Openstack-System-Scope: None May 30 12:10:54.102555 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: User-Agent: python-urllib3/1.26.9 May 30 12:10:54.102555 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Auth-Token: gAAAAABilLLAYcX6lTFc6UYhtte3qOfoT2D6p3xmrlj8lFSs8RM3SsxCJSweWMgYMCOyRE51N8YW3rSrU1JYG-ztTk5m_gEJkCNSzYatjS4LK9S2ataZ1OqgPb6zqIfN7SdtrBc2fQRHJMFEqwi_DhRkSGnSViHvbRwm6OQNgq1VdpWmApLUG3U May 30 12:10:54.102555 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Domain-Id: None May 30 12:10:54.102555 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Domain-Name: None May 30 12:10:54.102555 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Identity-Status: Confirmed May 30 12:10:54.102555 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Is-Admin-Project: True May 30 12:10:54.102555 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Domain-Id: default May 30 12:10:54.102555 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Domain-Name: Default May 30 12:10:54.102555 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Id: 20763921c37c4e81bba702e09bf628b2 May 30 12:10:54.102555 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Name: tempest-AttachVolumeNegativeTest-1368164951 May 30 12:10:54.102555 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Role: reader,member May 30 12:10:54.102555 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Roles: reader,member May 30 12:10:54.104182 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/20763921c37c4e81bba702e09bf628b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/20763921c37c4e81bba702e09bf628b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/20763921c37c4e81bba702e09bf628b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_20763921c37c4e81bba702e09bf628b2", "adminURL": "http://10.222.0.32:8080"}]}] May 30 12:10:54.104182 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Tenant: tempest-AttachVolumeNegativeTest-1368164951 May 30 12:10:54.104182 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Tenant-Id: 20763921c37c4e81bba702e09bf628b2 May 30 12:10:54.104182 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1368164951 May 30 12:10:54.104182 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User: tempest-AttachVolumeNegativeTest-1368164951-project May 30 12:10:54.104182 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Domain-Id: default May 30 12:10:54.104182 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Domain-Name: Default May 30 12:10:54.104182 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Id: 7575179edbda45208561c983fc5b956c May 30 12:10:54.104182 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Name: tempest-AttachVolumeNegativeTest-1368164951-project May 30 12:10:54.104182 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: method: > May 30 12:10:54.104182 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: exception: Instance ed036712-bf1c-4eaa-9736-b486dc1f76bf could not be found. May 30 12:10:54.104182 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: action_args: {'id': 'ed036712-bf1c-4eaa-9736-b486dc1f76bf'} May 30 12:10:54.104997 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:10:54.104997 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:10:54.104997 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:10:54.104997 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:10:54.104997 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:10:54.104997 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:10:54.104997 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:10:54.104997 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:10:54.104997 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:10:54.104997 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:10:54.104997 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed036712-bf1c-4eaa-9736-b486dc1f76bf could not be found. May 30 12:10:54.104997 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:10:54.104997 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:10:54.104997 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:10:54.104997 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:10:54.104997 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:10:54.104997 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:10:54.104997 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:10:54.104997 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:10:54.104997 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:10:54.106190 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:10:54.106190 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 30 12:10:54.106190 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 30 12:10:54.106190 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 30 12:10:54.106190 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 30 12:10:54.106190 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 30 12:10:54.106190 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 30 12:10:54.106190 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:10:54.106190 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:10:54.106190 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed036712-bf1c-4eaa-9736-b486dc1f76bf could not be found. May 30 12:10:54.106190 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:10:54.106190 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:10:54.106190 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:10:54.106190 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:10:54.106190 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:10:54.106190 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:10:54.106190 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:10:54.106190 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:10:54.106190 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed036712-bf1c-4eaa-9736-b486dc1f76bf could not be found. May 30 12:10:54.106190 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:10:54.110436 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-6cc62140-030c-4f8f-bfe5-37e7907d259b tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Returning 404 to user: Instance ed036712-bf1c-4eaa-9736-b486dc1f76bf could not be found. {{(pid=117671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:10:54.114487 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-6cc62140-030c-4f8f-bfe5-37e7907d259b tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "DELETE /compute/v2.1/servers/ed036712-bf1c-4eaa-9736-b486dc1f76bf" status: 404 len: 111 microversion: 2.1 time: 0.049630 May 30 12:10:54.115384 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 416/821] 10.222.0.32 () {58 vars in 1238 bytes} [Mon May 30 12:10:54 2022] DELETE /compute/v2.1/servers/ed036712-bf1c-4eaa-9736-b486dc1f76bf => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 30 12:10:54.124605 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-44d4b7d0-c537-4954-98da-ae53d9f672cb tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:54.125884 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-44d4b7d0-c537-4954-98da-ae53d9f672cb tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: ed036712-bf1c-4eaa-9736-b486dc1f76bf] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:54.133676 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-44d4b7d0-c537-4954-98da-ae53d9f672cb tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:54.134406 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-44d4b7d0-c537-4954-98da-ae53d9f672cb tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:54.135361 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-44d4b7d0-c537-4954-98da-ae53d9f672cb tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:54.135982 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-44d4b7d0-c537-4954-98da-ae53d9f672cb tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:54.154618 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.wsgi [None req-44d4b7d0-c537-4954-98da-ae53d9f672cb tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] HTTP exception thrown: Instance ed036712-bf1c-4eaa-9736-b486dc1f76bf could not be found. May 30 12:10:54.157569 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-44d4b7d0-c537-4954-98da-ae53d9f672cb tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Request method failure captured: May 30 12:10:54.157569 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: request: GET /compute/v2.1/servers/ed036712-bf1c-4eaa-9736-b486dc1f76bf HTTP/1.1 May 30 12:10:54.157569 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Accept: application/json May 30 12:10:54.157569 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Accept-Encoding: identity May 30 12:10:54.157569 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Connection: close May 30 12:10:54.157569 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Content-Length: 0 May 30 12:10:54.157569 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Content-Type: application/json May 30 12:10:54.157569 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Host: 10.222.0.32 May 30 12:10:54.157569 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Openstack-System-Scope: None May 30 12:10:54.157569 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: User-Agent: python-urllib3/1.26.9 May 30 12:10:54.157569 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Auth-Token: gAAAAABilLLAYcX6lTFc6UYhtte3qOfoT2D6p3xmrlj8lFSs8RM3SsxCJSweWMgYMCOyRE51N8YW3rSrU1JYG-ztTk5m_gEJkCNSzYatjS4LK9S2ataZ1OqgPb6zqIfN7SdtrBc2fQRHJMFEqwi_DhRkSGnSViHvbRwm6OQNgq1VdpWmApLUG3U May 30 12:10:54.157569 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Domain-Id: None May 30 12:10:54.157569 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Domain-Name: None May 30 12:10:54.157569 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Identity-Status: Confirmed May 30 12:10:54.157569 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Is-Admin-Project: True May 30 12:10:54.157569 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Domain-Id: default May 30 12:10:54.157569 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Domain-Name: Default May 30 12:10:54.157569 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Id: 20763921c37c4e81bba702e09bf628b2 May 30 12:10:54.157569 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Name: tempest-AttachVolumeNegativeTest-1368164951 May 30 12:10:54.157569 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Role: reader,member May 30 12:10:54.157569 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Roles: reader,member May 30 12:10:54.158968 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/20763921c37c4e81bba702e09bf628b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/20763921c37c4e81bba702e09bf628b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/20763921c37c4e81bba702e09bf628b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_20763921c37c4e81bba702e09bf628b2", "adminURL": "http://10.222.0.32:8080"}]}] May 30 12:10:54.158968 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant: tempest-AttachVolumeNegativeTest-1368164951 May 30 12:10:54.158968 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant-Id: 20763921c37c4e81bba702e09bf628b2 May 30 12:10:54.158968 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1368164951 May 30 12:10:54.158968 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User: tempest-AttachVolumeNegativeTest-1368164951-project May 30 12:10:54.158968 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Domain-Id: default May 30 12:10:54.158968 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Domain-Name: Default May 30 12:10:54.158968 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Id: 7575179edbda45208561c983fc5b956c May 30 12:10:54.158968 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Name: tempest-AttachVolumeNegativeTest-1368164951-project May 30 12:10:54.158968 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: method: > May 30 12:10:54.158968 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: exception: Instance ed036712-bf1c-4eaa-9736-b486dc1f76bf could not be found. May 30 12:10:54.158968 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: action_args: {'id': 'ed036712-bf1c-4eaa-9736-b486dc1f76bf'} May 30 12:10:54.160152 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:10:54.160152 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:10:54.160152 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:10:54.160152 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:10:54.160152 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:10:54.160152 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:10:54.160152 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:10:54.160152 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:10:54.160152 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:10:54.160152 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:10:54.160152 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed036712-bf1c-4eaa-9736-b486dc1f76bf could not be found. May 30 12:10:54.160152 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:10:54.160152 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:10:54.160152 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:10:54.160152 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:10:54.160152 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:10:54.160152 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:10:54.160152 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:10:54.160152 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:10:54.160152 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:10:54.161383 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:10:54.161383 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 30 12:10:54.161383 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 30 12:10:54.161383 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 30 12:10:54.161383 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 30 12:10:54.161383 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:10:54.161383 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:10:54.161383 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed036712-bf1c-4eaa-9736-b486dc1f76bf could not be found. May 30 12:10:54.161383 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:10:54.161383 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:10:54.161383 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:10:54.161383 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:10:54.161383 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:10:54.161383 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:10:54.161383 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:10:54.161383 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:10:54.161383 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed036712-bf1c-4eaa-9736-b486dc1f76bf could not be found. May 30 12:10:54.161383 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:10:54.164398 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-44d4b7d0-c537-4954-98da-ae53d9f672cb tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Returning 404 to user: Instance ed036712-bf1c-4eaa-9736-b486dc1f76bf could not be found. {{(pid=117670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:10:54.165437 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-44d4b7d0-c537-4954-98da-ae53d9f672cb tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/ed036712-bf1c-4eaa-9736-b486dc1f76bf" status: 404 len: 111 microversion: 2.1 time: 0.044895 May 30 12:10:54.166161 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 406/822] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:10:54 2022] GET /compute/v2.1/servers/ed036712-bf1c-4eaa-9736-b486dc1f76bf => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 30 12:10:54.174168 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-11d453a7-f13d-4eac-b726-a835d6b1ed95 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:54.174961 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-11d453a7-f13d-4eac-b726-a835d6b1ed95 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: 611aebbd-06cc-46a9-ba2f-a01decf8d94a] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:54.181744 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-11d453a7-f13d-4eac-b726-a835d6b1ed95 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:54.182196 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-11d453a7-f13d-4eac-b726-a835d6b1ed95 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:54.182978 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-11d453a7-f13d-4eac-b726-a835d6b1ed95 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:54.183411 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-11d453a7-f13d-4eac-b726-a835d6b1ed95 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:54.198798 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.wsgi [None req-11d453a7-f13d-4eac-b726-a835d6b1ed95 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] HTTP exception thrown: Instance 611aebbd-06cc-46a9-ba2f-a01decf8d94a could not be found. May 30 12:10:54.200543 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-11d453a7-f13d-4eac-b726-a835d6b1ed95 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Request method failure captured: May 30 12:10:54.200543 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: request: DELETE /compute/v2.1/servers/611aebbd-06cc-46a9-ba2f-a01decf8d94a HTTP/1.1 May 30 12:10:54.200543 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Accept: application/json May 30 12:10:54.200543 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Accept-Encoding: identity May 30 12:10:54.200543 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Connection: close May 30 12:10:54.200543 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Content-Length: 0 May 30 12:10:54.200543 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Content-Type: application/json May 30 12:10:54.200543 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Host: 10.222.0.32 May 30 12:10:54.200543 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Openstack-System-Scope: None May 30 12:10:54.200543 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: User-Agent: python-urllib3/1.26.9 May 30 12:10:54.200543 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Auth-Token: gAAAAABilLLAYcX6lTFc6UYhtte3qOfoT2D6p3xmrlj8lFSs8RM3SsxCJSweWMgYMCOyRE51N8YW3rSrU1JYG-ztTk5m_gEJkCNSzYatjS4LK9S2ataZ1OqgPb6zqIfN7SdtrBc2fQRHJMFEqwi_DhRkSGnSViHvbRwm6OQNgq1VdpWmApLUG3U May 30 12:10:54.200543 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Domain-Id: None May 30 12:10:54.200543 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Domain-Name: None May 30 12:10:54.200543 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Identity-Status: Confirmed May 30 12:10:54.200543 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Is-Admin-Project: True May 30 12:10:54.200543 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Domain-Id: default May 30 12:10:54.200543 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Domain-Name: Default May 30 12:10:54.200543 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Id: 20763921c37c4e81bba702e09bf628b2 May 30 12:10:54.200543 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Name: tempest-AttachVolumeNegativeTest-1368164951 May 30 12:10:54.200543 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Role: reader,member May 30 12:10:54.200543 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Roles: reader,member May 30 12:10:54.201907 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/20763921c37c4e81bba702e09bf628b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/20763921c37c4e81bba702e09bf628b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/20763921c37c4e81bba702e09bf628b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_20763921c37c4e81bba702e09bf628b2", "adminURL": "http://10.222.0.32:8080"}]}] May 30 12:10:54.201907 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Tenant: tempest-AttachVolumeNegativeTest-1368164951 May 30 12:10:54.201907 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Tenant-Id: 20763921c37c4e81bba702e09bf628b2 May 30 12:10:54.201907 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1368164951 May 30 12:10:54.201907 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User: tempest-AttachVolumeNegativeTest-1368164951-project May 30 12:10:54.201907 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Domain-Id: default May 30 12:10:54.201907 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Domain-Name: Default May 30 12:10:54.201907 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Id: 7575179edbda45208561c983fc5b956c May 30 12:10:54.201907 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Name: tempest-AttachVolumeNegativeTest-1368164951-project May 30 12:10:54.201907 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: method: > May 30 12:10:54.201907 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: exception: Instance 611aebbd-06cc-46a9-ba2f-a01decf8d94a could not be found. May 30 12:10:54.201907 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: action_args: {'id': '611aebbd-06cc-46a9-ba2f-a01decf8d94a'} May 30 12:10:54.202768 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:10:54.202768 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:10:54.202768 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:10:54.202768 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:10:54.202768 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:10:54.202768 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:10:54.202768 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:10:54.202768 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:10:54.202768 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:10:54.202768 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:10:54.202768 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 611aebbd-06cc-46a9-ba2f-a01decf8d94a could not be found. May 30 12:10:54.202768 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:10:54.202768 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:10:54.202768 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:10:54.202768 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:10:54.202768 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:10:54.202768 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:10:54.202768 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:10:54.202768 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:10:54.202768 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:10:54.204071 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:10:54.204071 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 30 12:10:54.204071 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 30 12:10:54.204071 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 30 12:10:54.204071 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 30 12:10:54.204071 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 30 12:10:54.204071 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 30 12:10:54.204071 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:10:54.204071 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:10:54.204071 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 611aebbd-06cc-46a9-ba2f-a01decf8d94a could not be found. May 30 12:10:54.204071 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:10:54.204071 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:10:54.204071 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:10:54.204071 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:10:54.204071 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:10:54.204071 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:10:54.204071 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:10:54.204071 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:10:54.204071 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 611aebbd-06cc-46a9-ba2f-a01decf8d94a could not be found. May 30 12:10:54.204071 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:10:54.205352 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-11d453a7-f13d-4eac-b726-a835d6b1ed95 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Returning 404 to user: Instance 611aebbd-06cc-46a9-ba2f-a01decf8d94a could not be found. {{(pid=117671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:10:54.205352 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-11d453a7-f13d-4eac-b726-a835d6b1ed95 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "DELETE /compute/v2.1/servers/611aebbd-06cc-46a9-ba2f-a01decf8d94a" status: 404 len: 111 microversion: 2.1 time: 0.031739 May 30 12:10:54.205352 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 417/823] 10.222.0.32 () {58 vars in 1238 bytes} [Mon May 30 12:10:54 2022] DELETE /compute/v2.1/servers/611aebbd-06cc-46a9-ba2f-a01decf8d94a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 30 12:10:54.212418 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-5628b657-c748-4dd9-8de4-3ac4e77b4937 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:54.213049 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-5628b657-c748-4dd9-8de4-3ac4e77b4937 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: 611aebbd-06cc-46a9-ba2f-a01decf8d94a] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:54.221260 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5628b657-c748-4dd9-8de4-3ac4e77b4937 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:54.222431 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5628b657-c748-4dd9-8de4-3ac4e77b4937 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:54.223635 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5628b657-c748-4dd9-8de4-3ac4e77b4937 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:54.224236 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5628b657-c748-4dd9-8de4-3ac4e77b4937 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:54.240215 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.wsgi [None req-5628b657-c748-4dd9-8de4-3ac4e77b4937 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] HTTP exception thrown: Instance 611aebbd-06cc-46a9-ba2f-a01decf8d94a could not be found. May 30 12:10:54.241814 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-5628b657-c748-4dd9-8de4-3ac4e77b4937 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Request method failure captured: May 30 12:10:54.241814 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: request: GET /compute/v2.1/servers/611aebbd-06cc-46a9-ba2f-a01decf8d94a HTTP/1.1 May 30 12:10:54.241814 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Accept: application/json May 30 12:10:54.241814 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Accept-Encoding: identity May 30 12:10:54.241814 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Connection: close May 30 12:10:54.241814 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Content-Length: 0 May 30 12:10:54.241814 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Content-Type: application/json May 30 12:10:54.241814 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Host: 10.222.0.32 May 30 12:10:54.241814 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Openstack-System-Scope: None May 30 12:10:54.241814 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: User-Agent: python-urllib3/1.26.9 May 30 12:10:54.241814 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Auth-Token: gAAAAABilLLAYcX6lTFc6UYhtte3qOfoT2D6p3xmrlj8lFSs8RM3SsxCJSweWMgYMCOyRE51N8YW3rSrU1JYG-ztTk5m_gEJkCNSzYatjS4LK9S2ataZ1OqgPb6zqIfN7SdtrBc2fQRHJMFEqwi_DhRkSGnSViHvbRwm6OQNgq1VdpWmApLUG3U May 30 12:10:54.241814 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Domain-Id: None May 30 12:10:54.241814 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Domain-Name: None May 30 12:10:54.241814 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Identity-Status: Confirmed May 30 12:10:54.241814 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Is-Admin-Project: True May 30 12:10:54.241814 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Domain-Id: default May 30 12:10:54.241814 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Domain-Name: Default May 30 12:10:54.241814 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Id: 20763921c37c4e81bba702e09bf628b2 May 30 12:10:54.241814 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Name: tempest-AttachVolumeNegativeTest-1368164951 May 30 12:10:54.241814 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Role: reader,member May 30 12:10:54.241814 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Roles: reader,member May 30 12:10:54.244266 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/20763921c37c4e81bba702e09bf628b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/20763921c37c4e81bba702e09bf628b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/20763921c37c4e81bba702e09bf628b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_20763921c37c4e81bba702e09bf628b2", "adminURL": "http://10.222.0.32:8080"}]}] May 30 12:10:54.244266 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant: tempest-AttachVolumeNegativeTest-1368164951 May 30 12:10:54.244266 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant-Id: 20763921c37c4e81bba702e09bf628b2 May 30 12:10:54.244266 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1368164951 May 30 12:10:54.244266 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User: tempest-AttachVolumeNegativeTest-1368164951-project May 30 12:10:54.244266 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Domain-Id: default May 30 12:10:54.244266 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Domain-Name: Default May 30 12:10:54.244266 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Id: 7575179edbda45208561c983fc5b956c May 30 12:10:54.244266 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Name: tempest-AttachVolumeNegativeTest-1368164951-project May 30 12:10:54.244266 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: method: > May 30 12:10:54.244266 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: exception: Instance 611aebbd-06cc-46a9-ba2f-a01decf8d94a could not be found. May 30 12:10:54.244266 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: action_args: {'id': '611aebbd-06cc-46a9-ba2f-a01decf8d94a'} May 30 12:10:54.245073 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:10:54.245073 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:10:54.245073 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:10:54.245073 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:10:54.245073 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:10:54.245073 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:10:54.245073 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:10:54.245073 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:10:54.245073 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:10:54.245073 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:10:54.245073 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 611aebbd-06cc-46a9-ba2f-a01decf8d94a could not be found. May 30 12:10:54.245073 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:10:54.245073 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:10:54.245073 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:10:54.245073 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:10:54.245073 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:10:54.245073 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:10:54.245073 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:10:54.245073 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:10:54.245073 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:10:54.246892 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:10:54.246892 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 30 12:10:54.246892 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 30 12:10:54.246892 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 30 12:10:54.246892 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 30 12:10:54.246892 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:10:54.246892 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:10:54.246892 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 611aebbd-06cc-46a9-ba2f-a01decf8d94a could not be found. May 30 12:10:54.246892 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:10:54.246892 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:10:54.246892 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:10:54.246892 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:10:54.246892 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:10:54.246892 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:10:54.246892 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:10:54.246892 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:10:54.246892 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 611aebbd-06cc-46a9-ba2f-a01decf8d94a could not be found. May 30 12:10:54.246892 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:10:54.247999 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-5628b657-c748-4dd9-8de4-3ac4e77b4937 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Returning 404 to user: Instance 611aebbd-06cc-46a9-ba2f-a01decf8d94a could not be found. {{(pid=117670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:10:54.247999 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-5628b657-c748-4dd9-8de4-3ac4e77b4937 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/611aebbd-06cc-46a9-ba2f-a01decf8d94a" status: 404 len: 111 microversion: 2.1 time: 0.036174 May 30 12:10:54.247999 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 407/824] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:10:54 2022] GET /compute/v2.1/servers/611aebbd-06cc-46a9-ba2f-a01decf8d94a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 30 12:10:55.456854 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-3834447d-fc7e-4e74-83fd-4e9e877fcf9b tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:55.457601 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-3834447d-fc7e-4e74-83fd-4e9e877fcf9b tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: 54ad4de0-2282-4baf-86a4-40d5ba1ba62a] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:55.466599 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3834447d-fc7e-4e74-83fd-4e9e877fcf9b tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:55.467202 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3834447d-fc7e-4e74-83fd-4e9e877fcf9b tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:55.467989 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3834447d-fc7e-4e74-83fd-4e9e877fcf9b tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:55.468885 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3834447d-fc7e-4e74-83fd-4e9e877fcf9b tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:55.491736 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.wsgi [None req-3834447d-fc7e-4e74-83fd-4e9e877fcf9b tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] HTTP exception thrown: Instance 54ad4de0-2282-4baf-86a4-40d5ba1ba62a could not be found. May 30 12:10:55.495608 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-3834447d-fc7e-4e74-83fd-4e9e877fcf9b tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Request method failure captured: May 30 12:10:55.495608 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: request: DELETE /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a HTTP/1.1 May 30 12:10:55.495608 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Accept: application/json May 30 12:10:55.495608 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Accept-Encoding: identity May 30 12:10:55.495608 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Connection: close May 30 12:10:55.495608 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Content-Length: 0 May 30 12:10:55.495608 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Content-Type: application/json May 30 12:10:55.495608 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Host: 10.222.0.32 May 30 12:10:55.495608 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Openstack-System-Scope: None May 30 12:10:55.495608 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: User-Agent: python-urllib3/1.26.9 May 30 12:10:55.495608 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Auth-Token: gAAAAABilLLAYcX6lTFc6UYhtte3qOfoT2D6p3xmrlj8lFSs8RM3SsxCJSweWMgYMCOyRE51N8YW3rSrU1JYG-ztTk5m_gEJkCNSzYatjS4LK9S2ataZ1OqgPb6zqIfN7SdtrBc2fQRHJMFEqwi_DhRkSGnSViHvbRwm6OQNgq1VdpWmApLUG3U May 30 12:10:55.495608 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Domain-Id: None May 30 12:10:55.495608 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Domain-Name: None May 30 12:10:55.495608 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Identity-Status: Confirmed May 30 12:10:55.495608 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Is-Admin-Project: True May 30 12:10:55.495608 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Domain-Id: default May 30 12:10:55.495608 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Domain-Name: Default May 30 12:10:55.495608 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Id: 20763921c37c4e81bba702e09bf628b2 May 30 12:10:55.495608 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Name: tempest-AttachVolumeNegativeTest-1368164951 May 30 12:10:55.495608 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Role: reader,member May 30 12:10:55.495608 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Roles: reader,member May 30 12:10:55.497197 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/20763921c37c4e81bba702e09bf628b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/20763921c37c4e81bba702e09bf628b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/20763921c37c4e81bba702e09bf628b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_20763921c37c4e81bba702e09bf628b2", "adminURL": "http://10.222.0.32:8080"}]}] May 30 12:10:55.497197 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Tenant: tempest-AttachVolumeNegativeTest-1368164951 May 30 12:10:55.497197 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Tenant-Id: 20763921c37c4e81bba702e09bf628b2 May 30 12:10:55.497197 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1368164951 May 30 12:10:55.497197 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User: tempest-AttachVolumeNegativeTest-1368164951-project May 30 12:10:55.497197 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Domain-Id: default May 30 12:10:55.497197 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Domain-Name: Default May 30 12:10:55.497197 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Id: 7575179edbda45208561c983fc5b956c May 30 12:10:55.497197 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Name: tempest-AttachVolumeNegativeTest-1368164951-project May 30 12:10:55.497197 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: method: > May 30 12:10:55.497197 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: exception: Instance 54ad4de0-2282-4baf-86a4-40d5ba1ba62a could not be found. May 30 12:10:55.497197 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: action_args: {'id': '54ad4de0-2282-4baf-86a4-40d5ba1ba62a'} May 30 12:10:55.497955 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:10:55.497955 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:10:55.497955 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:10:55.497955 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:10:55.497955 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:10:55.497955 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:10:55.497955 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:10:55.497955 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:10:55.497955 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:10:55.497955 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:10:55.497955 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54ad4de0-2282-4baf-86a4-40d5ba1ba62a could not be found. May 30 12:10:55.497955 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:10:55.497955 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:10:55.497955 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:10:55.497955 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:10:55.497955 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:10:55.497955 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:10:55.497955 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:10:55.497955 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:10:55.497955 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:10:55.499151 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:10:55.499151 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 30 12:10:55.499151 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 30 12:10:55.499151 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 30 12:10:55.499151 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 30 12:10:55.499151 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 30 12:10:55.499151 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 30 12:10:55.499151 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:10:55.499151 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:10:55.499151 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54ad4de0-2282-4baf-86a4-40d5ba1ba62a could not be found. May 30 12:10:55.499151 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:10:55.499151 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:10:55.499151 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:10:55.499151 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:10:55.499151 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:10:55.499151 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:10:55.499151 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:10:55.499151 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:10:55.499151 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54ad4de0-2282-4baf-86a4-40d5ba1ba62a could not be found. May 30 12:10:55.499151 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:10:55.504541 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-3834447d-fc7e-4e74-83fd-4e9e877fcf9b tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Returning 404 to user: Instance 54ad4de0-2282-4baf-86a4-40d5ba1ba62a could not be found. {{(pid=117671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:10:55.505694 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-3834447d-fc7e-4e74-83fd-4e9e877fcf9b tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "DELETE /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a" status: 404 len: 111 microversion: 2.1 time: 0.055767 May 30 12:10:55.509158 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 418/825] 10.222.0.32 () {58 vars in 1238 bytes} [Mon May 30 12:10:55 2022] DELETE /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 30 12:10:55.514371 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-bc52514c-a20f-47af-a54c-b19224e287d7 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:55.515003 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-bc52514c-a20f-47af-a54c-b19224e287d7 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] [instance: 54ad4de0-2282-4baf-86a4-40d5ba1ba62a] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:55.529050 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-bc52514c-a20f-47af-a54c-b19224e287d7 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:55.529624 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-bc52514c-a20f-47af-a54c-b19224e287d7 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:55.530842 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-bc52514c-a20f-47af-a54c-b19224e287d7 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:55.531506 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-bc52514c-a20f-47af-a54c-b19224e287d7 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:55.546745 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.wsgi [None req-bc52514c-a20f-47af-a54c-b19224e287d7 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] HTTP exception thrown: Instance 54ad4de0-2282-4baf-86a4-40d5ba1ba62a could not be found. May 30 12:10:55.548463 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-bc52514c-a20f-47af-a54c-b19224e287d7 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Request method failure captured: May 30 12:10:55.548463 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: request: GET /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a HTTP/1.1 May 30 12:10:55.548463 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Accept: application/json May 30 12:10:55.548463 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Accept-Encoding: identity May 30 12:10:55.548463 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Connection: close May 30 12:10:55.548463 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Content-Length: 0 May 30 12:10:55.548463 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Content-Type: application/json May 30 12:10:55.548463 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Host: 10.222.0.32 May 30 12:10:55.548463 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Openstack-System-Scope: None May 30 12:10:55.548463 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: User-Agent: python-urllib3/1.26.9 May 30 12:10:55.548463 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Auth-Token: gAAAAABilLLAYcX6lTFc6UYhtte3qOfoT2D6p3xmrlj8lFSs8RM3SsxCJSweWMgYMCOyRE51N8YW3rSrU1JYG-ztTk5m_gEJkCNSzYatjS4LK9S2ataZ1OqgPb6zqIfN7SdtrBc2fQRHJMFEqwi_DhRkSGnSViHvbRwm6OQNgq1VdpWmApLUG3U May 30 12:10:55.548463 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Domain-Id: None May 30 12:10:55.548463 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Domain-Name: None May 30 12:10:55.548463 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Identity-Status: Confirmed May 30 12:10:55.548463 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Is-Admin-Project: True May 30 12:10:55.548463 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Domain-Id: default May 30 12:10:55.548463 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Domain-Name: Default May 30 12:10:55.548463 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Id: 20763921c37c4e81bba702e09bf628b2 May 30 12:10:55.548463 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Name: tempest-AttachVolumeNegativeTest-1368164951 May 30 12:10:55.548463 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Role: reader,member May 30 12:10:55.548463 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Roles: reader,member May 30 12:10:55.549922 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/20763921c37c4e81bba702e09bf628b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/20763921c37c4e81bba702e09bf628b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/20763921c37c4e81bba702e09bf628b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_20763921c37c4e81bba702e09bf628b2", "adminURL": "http://10.222.0.32:8080"}]}] May 30 12:10:55.549922 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant: tempest-AttachVolumeNegativeTest-1368164951 May 30 12:10:55.549922 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant-Id: 20763921c37c4e81bba702e09bf628b2 May 30 12:10:55.549922 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1368164951 May 30 12:10:55.549922 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User: tempest-AttachVolumeNegativeTest-1368164951-project May 30 12:10:55.549922 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Domain-Id: default May 30 12:10:55.549922 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Domain-Name: Default May 30 12:10:55.549922 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Id: 7575179edbda45208561c983fc5b956c May 30 12:10:55.549922 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Name: tempest-AttachVolumeNegativeTest-1368164951-project May 30 12:10:55.549922 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: method: > May 30 12:10:55.549922 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: exception: Instance 54ad4de0-2282-4baf-86a4-40d5ba1ba62a could not be found. May 30 12:10:55.549922 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: action_args: {'id': '54ad4de0-2282-4baf-86a4-40d5ba1ba62a'} May 30 12:10:55.550877 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:10:55.550877 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:10:55.550877 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:10:55.550877 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:10:55.550877 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:10:55.550877 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:10:55.550877 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:10:55.550877 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:10:55.550877 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:10:55.550877 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:10:55.550877 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54ad4de0-2282-4baf-86a4-40d5ba1ba62a could not be found. May 30 12:10:55.550877 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:10:55.550877 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:10:55.550877 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:10:55.550877 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:10:55.550877 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:10:55.550877 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:10:55.550877 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:10:55.550877 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:10:55.550877 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:10:55.552153 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:10:55.552153 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 30 12:10:55.552153 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 30 12:10:55.552153 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 30 12:10:55.552153 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 30 12:10:55.552153 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:10:55.552153 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:10:55.552153 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54ad4de0-2282-4baf-86a4-40d5ba1ba62a could not be found. May 30 12:10:55.552153 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:10:55.552153 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:10:55.552153 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:10:55.552153 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:10:55.552153 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:10:55.552153 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:10:55.552153 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:10:55.552153 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:10:55.552153 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54ad4de0-2282-4baf-86a4-40d5ba1ba62a could not be found. May 30 12:10:55.552153 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:10:55.553635 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-bc52514c-a20f-47af-a54c-b19224e287d7 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] Returning 404 to user: Instance 54ad4de0-2282-4baf-86a4-40d5ba1ba62a could not be found. {{(pid=117670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:10:55.553635 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-bc52514c-a20f-47af-a54c-b19224e287d7 tempest-AttachVolumeNegativeTest-1368164951 tempest-AttachVolumeNegativeTest-1368164951-project] 10.222.0.32 "GET /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a" status: 404 len: 111 microversion: 2.1 time: 0.039752 May 30 12:10:55.553635 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 408/826] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:10:55 2022] GET /compute/v2.1/servers/54ad4de0-2282-4baf-86a4-40d5ba1ba62a => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 30 12:11:12.757915 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-252bb30a-d41f-4280-b63b-dc3f1a99c317 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Action: 'create', calling method: .version_select at 0x7f0ef8698dc0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-486287668", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPBAX0xp1+amEqvItQPTexljD/1mnd0mh1qp2GKNwxunD8hGXMh254ehH0QvNI8DkyVVeRe9Wxos23E/g/M9cjfUKOtJaS8a5z/Q39ygTsaFATE+fbI5Q+1QcRNkXmGTTg=="}} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:11:12.762259 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_api:SELECT=15 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:11:12.763013 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell1:SELECT=35 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:11:12.777900 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.quota [None req-252bb30a-d41f-4280-b63b-dc3f1a99c317 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Getting quotas for project dc19bd60cde244559a823a47293540f7. Resources: {'key_pairs'} {{(pid=117671) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 30 12:11:12.782009 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.quota [None req-252bb30a-d41f-4280-b63b-dc3f1a99c317 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Getting quotas for user c8915c74c4d24d2cb1cded5aa7927120 and project dc19bd60cde244559a823a47293540f7. Resources: {'key_pairs'} {{(pid=117671) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 30 12:11:12.809735 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-252bb30a-d41f-4280-b63b-dc3f1a99c317 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.055835 May 30 12:11:12.810337 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 419/827] 10.222.0.32 () {60 vars in 1158 bytes} [Mon May 30 12:11:12 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:11:12.936997 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-1dc38cd7-27b5-421b-a6a7-b671dfffa32a tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-853839946", "imageRef": "1ae6baf0-61b6-4bd7-8dfd-6c10c9bfc345", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-486287668", "networks": [{"uuid": "a121b1f9-7b00-47bf-84b5-7a169b4dfa4a"}]}} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:11:12.946660 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:11:12.947868 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=67,nova_cell1:INSERT=3 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:11:13.016644 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.network.neutron [None req-1dc38cd7-27b5-421b-a6a7-b671dfffa32a tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] validate_networks() for [('a121b1f9-7b00-47bf-84b5-7a169b4dfa4a', None, None, None, None, None)] {{(pid=117670) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 30 12:11:13.425952 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-1dc38cd7-27b5-421b-a6a7-b671dfffa32a tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Flavor limits 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 30 12:11:13.426526 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-1dc38cd7-27b5-421b-a6a7-b671dfffa32a tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Image limits 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 30 12:11:13.427008 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-1dc38cd7-27b5-421b-a6a7-b671dfffa32a tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Flavor pref 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 30 12:11:13.427425 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-1dc38cd7-27b5-421b-a6a7-b671dfffa32a tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Image pref 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 30 12:11:13.427841 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-1dc38cd7-27b5-421b-a6a7-b671dfffa32a tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 30 12:11:13.437184 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1dc38cd7-27b5-421b-a6a7-b671dfffa32a tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:13.437715 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1dc38cd7-27b5-421b-a6a7-b671dfffa32a tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:13.438708 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1dc38cd7-27b5-421b-a6a7-b671dfffa32a tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:13.439146 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1dc38cd7-27b5-421b-a6a7-b671dfffa32a tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:13.456950 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.quota [None req-1dc38cd7-27b5-421b-a6a7-b671dfffa32a tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Getting quotas for project dc19bd60cde244559a823a47293540f7. Resources: {'cores', 'instances', 'ram'} {{(pid=117670) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 30 12:11:13.461248 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.quota [None req-1dc38cd7-27b5-421b-a6a7-b671dfffa32a tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Getting quotas for user c8915c74c4d24d2cb1cded5aa7927120 and project dc19bd60cde244559a823a47293540f7. Resources: {'cores', 'instances', 'ram'} {{(pid=117670) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 30 12:11:13.473228 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-1dc38cd7-27b5-421b-a6a7-b671dfffa32a tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Going to run 1 instances... {{(pid=117670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 30 12:11:13.475447 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-1dc38cd7-27b5-421b-a6a7-b671dfffa32a tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] [instance: 4eb46ab6-5aba-438a-b5d0-b04d6ddee02e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1ae6baf0-61b6-4bd7-8dfd-6c10c9bfc345',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 30 12:11:13.521171 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-1dc38cd7-27b5-421b-a6a7-b671dfffa32a tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.587996 May 30 12:11:13.521954 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 409/828] 10.222.0.32 () {60 vars in 1146 bytes} [Mon May 30 12:11:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 589 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 30 12:11:13.531691 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-616055ab-d229-49fe-816e-a9c3d499cf58 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:13.532344 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-616055ab-d229-49fe-816e-a9c3d499cf58 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] [instance: 4eb46ab6-5aba-438a-b5d0-b04d6ddee02e] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:13.600552 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-616055ab-d229-49fe-816e-a9c3d499cf58 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8915c74c4d24d2cb1cded5aa7927120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc19bd60cde244559a823a47293540f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:13.611700 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-616055ab-d229-49fe-816e-a9c3d499cf58 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] 10.222.0.32 "GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e" status: 200 len: 1257 microversion: 2.1 time: 0.083334 May 30 12:11:13.612493 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 420/829] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:11:13 2022] GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e => generated 1257 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:11:14.630104 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-e9e77844-1e29-4e33-9f3d-afc08f985921 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:14.630746 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-e9e77844-1e29-4e33-9f3d-afc08f985921 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] [instance: 4eb46ab6-5aba-438a-b5d0-b04d6ddee02e] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:14.662025 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e9e77844-1e29-4e33-9f3d-afc08f985921 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:14.664727 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e9e77844-1e29-4e33-9f3d-afc08f985921 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:14.667092 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e9e77844-1e29-4e33-9f3d-afc08f985921 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:14.667585 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e9e77844-1e29-4e33-9f3d-afc08f985921 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:14.758104 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-e9e77844-1e29-4e33-9f3d-afc08f985921 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8915c74c4d24d2cb1cded5aa7927120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc19bd60cde244559a823a47293540f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:14.765974 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-e9e77844-1e29-4e33-9f3d-afc08f985921 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] 10.222.0.32 "GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e" status: 200 len: 1327 microversion: 2.1 time: 0.141607 May 30 12:11:14.766944 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 410/830] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:11:14 2022] GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e => generated 1327 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:11:15.789390 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-72589b44-e83f-474d-b6e6-cb12d8669d13 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:15.790007 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-72589b44-e83f-474d-b6e6-cb12d8669d13 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] [instance: 4eb46ab6-5aba-438a-b5d0-b04d6ddee02e] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:15.819180 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-72589b44-e83f-474d-b6e6-cb12d8669d13 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:15.819669 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-72589b44-e83f-474d-b6e6-cb12d8669d13 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:15.821899 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-72589b44-e83f-474d-b6e6-cb12d8669d13 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:15.822379 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-72589b44-e83f-474d-b6e6-cb12d8669d13 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:16.096710 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-72589b44-e83f-474d-b6e6-cb12d8669d13 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8915c74c4d24d2cb1cded5aa7927120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc19bd60cde244559a823a47293540f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:16.104394 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-72589b44-e83f-474d-b6e6-cb12d8669d13 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] 10.222.0.32 "GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e" status: 200 len: 1357 microversion: 2.1 time: 0.324055 May 30 12:11:16.108083 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 421/831] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:11:15 2022] GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e => generated 1357 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:11:17.093317 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-9c005307-f28d-47ee-b2e3-ea5b2919c982 req-743c16a3-2986-4cf4-be55-54f12c5073ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4eb46ab6-5aba-438a-b5d0-b04d6ddee02e", "tag": "a3736af0-e6ce-4bc1-adc2-3c3c8417fdb9"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:11:17.125290 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-5c329735-8a21-4c2c-b721-e993d9c3076a tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:17.125985 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-5c329735-8a21-4c2c-b721-e993d9c3076a tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] [instance: 4eb46ab6-5aba-438a-b5d0-b04d6ddee02e] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:17.162359 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-9c005307-f28d-47ee-b2e3-ea5b2919c982 req-743c16a3-2986-4cf4-be55-54f12c5073ec service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:17.162936 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5c329735-8a21-4c2c-b721-e993d9c3076a tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:17.163518 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5c329735-8a21-4c2c-b721-e993d9c3076a tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:17.164990 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5c329735-8a21-4c2c-b721-e993d9c3076a tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:17.166624 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-9c005307-f28d-47ee-b2e3-ea5b2919c982 req-743c16a3-2986-4cf4-be55-54f12c5073ec service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:17.171361 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5c329735-8a21-4c2c-b721-e993d9c3076a tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:17.217926 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-9c005307-f28d-47ee-b2e3-ea5b2919c982 req-743c16a3-2986-4cf4-be55-54f12c5073ec service nova] Creating event network-changed:a3736af0-e6ce-4bc1-adc2-3c3c8417fdb9 for instance 4eb46ab6-5aba-438a-b5d0-b04d6ddee02e on hv-cinder-84051 May 30 12:11:17.240881 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-9c005307-f28d-47ee-b2e3-ea5b2919c982 req-743c16a3-2986-4cf4-be55-54f12c5073ec service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157135 May 30 12:11:17.243843 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 411/832] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:11:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 30 12:11:17.537387 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-5c329735-8a21-4c2c-b721-e993d9c3076a tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8915c74c4d24d2cb1cded5aa7927120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc19bd60cde244559a823a47293540f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:17.546500 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-5c329735-8a21-4c2c-b721-e993d9c3076a tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] 10.222.0.32 "GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e" status: 200 len: 1357 microversion: 2.1 time: 0.425083 May 30 12:11:17.551075 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 422/833] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:11:17 2022] GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e => generated 1357 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:11:18.569260 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-0041c9ef-d34f-48a7-99c9-7f91253b50be tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:18.570019 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-0041c9ef-d34f-48a7-99c9-7f91253b50be tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] [instance: 4eb46ab6-5aba-438a-b5d0-b04d6ddee02e] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:18.607838 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-0041c9ef-d34f-48a7-99c9-7f91253b50be tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:18.608624 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-0041c9ef-d34f-48a7-99c9-7f91253b50be tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:18.615416 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-0041c9ef-d34f-48a7-99c9-7f91253b50be tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:18.617553 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-0041c9ef-d34f-48a7-99c9-7f91253b50be tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:18.863651 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-0041c9ef-d34f-48a7-99c9-7f91253b50be tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8915c74c4d24d2cb1cded5aa7927120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc19bd60cde244559a823a47293540f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:18.875489 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-0041c9ef-d34f-48a7-99c9-7f91253b50be tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] 10.222.0.32 "GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e" status: 200 len: 1357 microversion: 2.1 time: 0.311540 May 30 12:11:18.876773 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 412/834] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:11:18 2022] GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e => generated 1357 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:11:19.892562 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-29445c6b-67d8-4651-b63c-e0935625c35b tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:19.893430 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-29445c6b-67d8-4651-b63c-e0935625c35b tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] [instance: 4eb46ab6-5aba-438a-b5d0-b04d6ddee02e] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:19.900125 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-29445c6b-67d8-4651-b63c-e0935625c35b tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:19.900906 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-29445c6b-67d8-4651-b63c-e0935625c35b tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:19.902204 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-29445c6b-67d8-4651-b63c-e0935625c35b tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:19.902857 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-29445c6b-67d8-4651-b63c-e0935625c35b tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:20.059417 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-29445c6b-67d8-4651-b63c-e0935625c35b tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8915c74c4d24d2cb1cded5aa7927120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc19bd60cde244559a823a47293540f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:20.078083 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-29445c6b-67d8-4651-b63c-e0935625c35b tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] 10.222.0.32 "GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e" status: 200 len: 1357 microversion: 2.1 time: 0.189007 May 30 12:11:20.079089 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 423/835] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:11:19 2022] GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e => generated 1357 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:11:20.283255 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-15999457-f966-4653-8e1d-d80778004285 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:20.285897 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-15999457-f966-4653-8e1d-d80778004285 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:20.299461 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-15999457-f966-4653-8e1d-d80778004285 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:20.300245 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-15999457-f966-4653-8e1d-d80778004285 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:20.301536 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-15999457-f966-4653-8e1d-d80778004285 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:20.302882 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-15999457-f966-4653-8e1d-d80778004285 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:20.337171 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-15999457-f966-4653-8e1d-d80778004285 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.059480 May 30 12:11:20.337754 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 413/836] 10.222.0.32 () {60 vars in 1342 bytes} [Mon May 30 12:11:20 2022] GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:11:20.403411 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-44b1ac80-e084-485f-a784-9e4c4490e3b6 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:20.404048 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-44b1ac80-e084-485f-a784-9e4c4490e3b6 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:20.411202 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-44b1ac80-e084-485f-a784-9e4c4490e3b6 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:20.411731 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-44b1ac80-e084-485f-a784-9e4c4490e3b6 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:20.412649 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-44b1ac80-e084-485f-a784-9e4c4490e3b6 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:20.413152 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-44b1ac80-e084-485f-a784-9e4c4490e3b6 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:20.441813 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-44b1ac80-e084-485f-a784-9e4c4490e3b6 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Going to try to terminate instance {{(pid=117671) delete /opt/stack/nova/nova/compute/api.py:2664}} May 30 12:11:20.542106 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-44b1ac80-e084-485f-a784-9e4c4490e3b6 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "DELETE /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c" status: 204 len: 0 microversion: 2.20 time: 0.142353 May 30 12:11:20.542850 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 424/837] 10.222.0.32 () {60 vars in 1279 bytes} [Mon May 30 12:11:20 2022] DELETE /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 30 12:11:20.552713 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-34b98a9b-833a-4007-9ace-bcb9a15334d6 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:20.553260 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-34b98a9b-833a-4007-9ace-bcb9a15334d6 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:20.561808 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-34b98a9b-833a-4007-9ace-bcb9a15334d6 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:20.562264 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-34b98a9b-833a-4007-9ace-bcb9a15334d6 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:20.563050 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-34b98a9b-833a-4007-9ace-bcb9a15334d6 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:20.563489 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-34b98a9b-833a-4007-9ace-bcb9a15334d6 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:20.703931 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-38e6d1a7-939a-42ae-8e64-f1f926dafc88 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2009460043", "imageRef": "b8ef93ed-af98-4d8c-9e1d-43d7b1f2b832", "flavorRef": "452"}} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:11:20.715843 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-34b98a9b-833a-4007-9ace-bcb9a15334d6 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:20.726502 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-34b98a9b-833a-4007-9ace-bcb9a15334d6 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:20.728357 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-34b98a9b-833a-4007-9ace-bcb9a15334d6 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:20.729910 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-34b98a9b-833a-4007-9ace-bcb9a15334d6 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c" status: 200 len: 1722 microversion: 2.20 time: 0.182621 May 30 12:11:20.730686 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 414/838] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:11:20 2022] GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c => generated 1722 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:11:20.760870 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.network.neutron [None req-38e6d1a7-939a-42ae-8e64-f1f926dafc88 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] validate_networks() for None {{(pid=117671) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 30 12:11:21.076027 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-38e6d1a7-939a-42ae-8e64-f1f926dafc88 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Flavor limits 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 30 12:11:21.077168 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-38e6d1a7-939a-42ae-8e64-f1f926dafc88 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Image limits 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 30 12:11:21.077829 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-38e6d1a7-939a-42ae-8e64-f1f926dafc88 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Flavor pref 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 30 12:11:21.078404 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-38e6d1a7-939a-42ae-8e64-f1f926dafc88 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Image pref 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 30 12:11:21.078979 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-38e6d1a7-939a-42ae-8e64-f1f926dafc88 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 30 12:11:21.089729 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-38e6d1a7-939a-42ae-8e64-f1f926dafc88 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:21.090437 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-38e6d1a7-939a-42ae-8e64-f1f926dafc88 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:21.091413 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-38e6d1a7-939a-42ae-8e64-f1f926dafc88 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:21.092013 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-38e6d1a7-939a-42ae-8e64-f1f926dafc88 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:21.094719 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-08ca0714-f773-4ed6-836b-51f11a4e4cf7 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:21.095597 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-08ca0714-f773-4ed6-836b-51f11a4e4cf7 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] [instance: 4eb46ab6-5aba-438a-b5d0-b04d6ddee02e] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:21.102239 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-08ca0714-f773-4ed6-836b-51f11a4e4cf7 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:21.102694 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-08ca0714-f773-4ed6-836b-51f11a4e4cf7 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:21.103468 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-08ca0714-f773-4ed6-836b-51f11a4e4cf7 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:21.103905 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-08ca0714-f773-4ed6-836b-51f11a4e4cf7 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:21.110574 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.quota [None req-38e6d1a7-939a-42ae-8e64-f1f926dafc88 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Getting quotas for project 0b9ea0feaee34c639f228a4f320f1aa3. Resources: {'cores', 'instances', 'ram'} {{(pid=117671) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 30 12:11:21.115172 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.quota [None req-38e6d1a7-939a-42ae-8e64-f1f926dafc88 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Getting quotas for user f869410b53b14949a0f066e0e4163a45 and project 0b9ea0feaee34c639f228a4f320f1aa3. Resources: {'cores', 'instances', 'ram'} {{(pid=117671) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 30 12:11:21.127949 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-38e6d1a7-939a-42ae-8e64-f1f926dafc88 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Going to run 1 instances... {{(pid=117671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 30 12:11:21.130606 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-38e6d1a7-939a-42ae-8e64-f1f926dafc88 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] [instance: 0fff5784-b25c-4dad-9826-af23b4f7658a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b8ef93ed-af98-4d8c-9e1d-43d7b1f2b832',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 30 12:11:21.180552 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-38e6d1a7-939a-42ae-8e64-f1f926dafc88 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.480690 May 30 12:11:21.186484 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 425/839] 10.222.0.32 () {60 vars in 1146 bytes} [Mon May 30 12:11:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 487 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 30 12:11:21.192413 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-d6242800-20fe-40b9-b20e-b52b8d22a08b tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:21.193269 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-d6242800-20fe-40b9-b20e-b52b8d22a08b tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] [instance: 0fff5784-b25c-4dad-9826-af23b4f7658a] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:21.282232 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-d6242800-20fe-40b9-b20e-b52b8d22a08b tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f869410b53b14949a0f066e0e4163a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9ea0feaee34c639f228a4f320f1aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:21.296422 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-d6242800-20fe-40b9-b20e-b52b8d22a08b tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] 10.222.0.32 "GET /compute/v2.1/servers/0fff5784-b25c-4dad-9826-af23b4f7658a" status: 200 len: 1215 microversion: 2.1 time: 0.107908 May 30 12:11:21.297207 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 426/840] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:11:21 2022] GET /compute/v2.1/servers/0fff5784-b25c-4dad-9826-af23b4f7658a => generated 1215 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:11:21.338966 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-08ca0714-f773-4ed6-836b-51f11a4e4cf7 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8915c74c4d24d2cb1cded5aa7927120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc19bd60cde244559a823a47293540f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:21.354620 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-08ca0714-f773-4ed6-836b-51f11a4e4cf7 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] 10.222.0.32 "GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e" status: 200 len: 1357 microversion: 2.1 time: 0.263351 May 30 12:11:21.356258 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 415/841] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:11:21 2022] GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e => generated 1357 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:11:21.749225 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-62cab567-6008-4c82-a83e-b301f3ea1de5 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:21.750199 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-62cab567-6008-4c82-a83e-b301f3ea1de5 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:21.758390 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-62cab567-6008-4c82-a83e-b301f3ea1de5 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:21.759207 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-62cab567-6008-4c82-a83e-b301f3ea1de5 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:21.759821 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-62cab567-6008-4c82-a83e-b301f3ea1de5 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:21.760360 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-62cab567-6008-4c82-a83e-b301f3ea1de5 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:21.918917 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-62cab567-6008-4c82-a83e-b301f3ea1de5 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:21.928022 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-62cab567-6008-4c82-a83e-b301f3ea1de5 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:21.930047 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-62cab567-6008-4c82-a83e-b301f3ea1de5 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:21.931249 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-62cab567-6008-4c82-a83e-b301f3ea1de5 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c" status: 200 len: 1722 microversion: 2.20 time: 0.186221 May 30 12:11:21.931980 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 427/842] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:11:21 2022] GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:11:22.314873 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-7eb6f6a4-725e-4b78-990a-c1c696ea6484 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:22.315500 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-7eb6f6a4-725e-4b78-990a-c1c696ea6484 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] [instance: 0fff5784-b25c-4dad-9826-af23b4f7658a] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:22.322518 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7eb6f6a4-725e-4b78-990a-c1c696ea6484 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:22.322973 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7eb6f6a4-725e-4b78-990a-c1c696ea6484 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:22.323787 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7eb6f6a4-725e-4b78-990a-c1c696ea6484 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:22.324252 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7eb6f6a4-725e-4b78-990a-c1c696ea6484 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:22.376474 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-facf414c-7993-42bb-a157-da06867ac8ce tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:22.380928 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-facf414c-7993-42bb-a157-da06867ac8ce tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] [instance: 4eb46ab6-5aba-438a-b5d0-b04d6ddee02e] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:22.388584 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-facf414c-7993-42bb-a157-da06867ac8ce tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:22.389597 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-facf414c-7993-42bb-a157-da06867ac8ce tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:22.390895 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-facf414c-7993-42bb-a157-da06867ac8ce tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:22.391566 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-facf414c-7993-42bb-a157-da06867ac8ce tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:22.425502 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-7eb6f6a4-725e-4b78-990a-c1c696ea6484 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f869410b53b14949a0f066e0e4163a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9ea0feaee34c639f228a4f320f1aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:22.435317 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-7eb6f6a4-725e-4b78-990a-c1c696ea6484 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] 10.222.0.32 "GET /compute/v2.1/servers/0fff5784-b25c-4dad-9826-af23b4f7658a" status: 200 len: 1219 microversion: 2.1 time: 0.123649 May 30 12:11:22.436147 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 416/843] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:11:22 2022] GET /compute/v2.1/servers/0fff5784-b25c-4dad-9826-af23b4f7658a => generated 1219 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:11:22.544617 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-facf414c-7993-42bb-a157-da06867ac8ce tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8915c74c4d24d2cb1cded5aa7927120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc19bd60cde244559a823a47293540f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:22.552845 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-facf414c-7993-42bb-a157-da06867ac8ce tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] 10.222.0.32 "GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e" status: 200 len: 1357 microversion: 2.1 time: 0.183191 May 30 12:11:22.553423 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 428/844] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:11:22 2022] GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e => generated 1357 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:11:22.950430 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-57649086-5415-42fc-920c-a1e805ffc419 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:22.951055 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-57649086-5415-42fc-920c-a1e805ffc419 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:22.958904 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-57649086-5415-42fc-920c-a1e805ffc419 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:22.959362 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-57649086-5415-42fc-920c-a1e805ffc419 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:22.964829 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-57649086-5415-42fc-920c-a1e805ffc419 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:22.967523 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-57649086-5415-42fc-920c-a1e805ffc419 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:23.136211 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-57649086-5415-42fc-920c-a1e805ffc419 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:23.150919 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-57649086-5415-42fc-920c-a1e805ffc419 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:23.152639 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-57649086-5415-42fc-920c-a1e805ffc419 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:23.153827 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-57649086-5415-42fc-920c-a1e805ffc419 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c" status: 200 len: 1722 microversion: 2.20 time: 0.207372 May 30 12:11:23.154389 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 417/845] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:11:22 2022] GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c => generated 1722 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 30 12:11:23.466770 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-8e25c41f-8110-4eee-9f59-d4e1c934ed79 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:23.467696 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-8e25c41f-8110-4eee-9f59-d4e1c934ed79 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] [instance: 0fff5784-b25c-4dad-9826-af23b4f7658a] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:23.477488 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8e25c41f-8110-4eee-9f59-d4e1c934ed79 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:23.477821 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8e25c41f-8110-4eee-9f59-d4e1c934ed79 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:23.478548 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8e25c41f-8110-4eee-9f59-d4e1c934ed79 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:23.479272 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8e25c41f-8110-4eee-9f59-d4e1c934ed79 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:23.562957 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-8e25c41f-8110-4eee-9f59-d4e1c934ed79 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f869410b53b14949a0f066e0e4163a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9ea0feaee34c639f228a4f320f1aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:23.571156 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-f3cbc5c5-f1b9-4bbd-b0b1-929c7a65e726 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:23.571705 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-f3cbc5c5-f1b9-4bbd-b0b1-929c7a65e726 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] [instance: 4eb46ab6-5aba-438a-b5d0-b04d6ddee02e] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:23.582202 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell0:SELECT=2 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:11:23.583802 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell0:SELECT=6 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:11:23.587688 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-8e25c41f-8110-4eee-9f59-d4e1c934ed79 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] 10.222.0.32 "GET /compute/v2.1/servers/0fff5784-b25c-4dad-9826-af23b4f7658a" status: 200 len: 1219 microversion: 2.1 time: 0.125251 May 30 12:11:23.590614 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 429/846] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:11:23 2022] GET /compute/v2.1/servers/0fff5784-b25c-4dad-9826-af23b4f7658a => generated 1219 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:11:23.593041 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f3cbc5c5-f1b9-4bbd-b0b1-929c7a65e726 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:23.594531 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f3cbc5c5-f1b9-4bbd-b0b1-929c7a65e726 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:23.595771 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f3cbc5c5-f1b9-4bbd-b0b1-929c7a65e726 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:23.596426 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f3cbc5c5-f1b9-4bbd-b0b1-929c7a65e726 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:23.776787 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-f3cbc5c5-f1b9-4bbd-b0b1-929c7a65e726 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8915c74c4d24d2cb1cded5aa7927120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc19bd60cde244559a823a47293540f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:23.792800 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-f3cbc5c5-f1b9-4bbd-b0b1-929c7a65e726 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] 10.222.0.32 "GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e" status: 200 len: 1357 microversion: 2.1 time: 0.226314 May 30 12:11:23.794221 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 418/847] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:11:23 2022] GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e => generated 1357 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:11:24.172491 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-05f02c95-0b57-49ea-9d6e-5d85e7bf687b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:24.173102 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-05f02c95-0b57-49ea-9d6e-5d85e7bf687b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:24.179655 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-05f02c95-0b57-49ea-9d6e-5d85e7bf687b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:24.180100 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-05f02c95-0b57-49ea-9d6e-5d85e7bf687b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:24.180991 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-05f02c95-0b57-49ea-9d6e-5d85e7bf687b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:24.181426 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-05f02c95-0b57-49ea-9d6e-5d85e7bf687b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:24.327906 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-05f02c95-0b57-49ea-9d6e-5d85e7bf687b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:24.337700 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-05f02c95-0b57-49ea-9d6e-5d85e7bf687b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:24.339605 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-05f02c95-0b57-49ea-9d6e-5d85e7bf687b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:24.341054 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-05f02c95-0b57-49ea-9d6e-5d85e7bf687b tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c" status: 200 len: 1722 microversion: 2.20 time: 0.172774 May 30 12:11:24.341613 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 430/848] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:11:24 2022] GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:11:24.607895 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-0070254e-ae20-4799-8698-d53bf2aec30d tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:24.608818 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-0070254e-ae20-4799-8698-d53bf2aec30d tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] [instance: 0fff5784-b25c-4dad-9826-af23b4f7658a] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:24.615730 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-0070254e-ae20-4799-8698-d53bf2aec30d tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:24.616614 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-0070254e-ae20-4799-8698-d53bf2aec30d tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:24.617429 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-0070254e-ae20-4799-8698-d53bf2aec30d tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:24.617872 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-0070254e-ae20-4799-8698-d53bf2aec30d tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:24.703757 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-0070254e-ae20-4799-8698-d53bf2aec30d tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f869410b53b14949a0f066e0e4163a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9ea0feaee34c639f228a4f320f1aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:24.714185 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-0070254e-ae20-4799-8698-d53bf2aec30d tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] 10.222.0.32 "GET /compute/v2.1/servers/0fff5784-b25c-4dad-9826-af23b4f7658a" status: 200 len: 1219 microversion: 2.1 time: 0.111565 May 30 12:11:24.714780 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 419/849] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:11:24 2022] GET /compute/v2.1/servers/0fff5784-b25c-4dad-9826-af23b4f7658a => generated 1219 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:11:24.811579 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-9b7f2cd6-0f35-41ed-afb8-7810e36d5a6a tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:24.812318 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-9b7f2cd6-0f35-41ed-afb8-7810e36d5a6a tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] [instance: 4eb46ab6-5aba-438a-b5d0-b04d6ddee02e] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:24.820062 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9b7f2cd6-0f35-41ed-afb8-7810e36d5a6a tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:24.820560 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9b7f2cd6-0f35-41ed-afb8-7810e36d5a6a tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:24.821348 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9b7f2cd6-0f35-41ed-afb8-7810e36d5a6a tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:24.821862 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9b7f2cd6-0f35-41ed-afb8-7810e36d5a6a tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:24.994316 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-9b7f2cd6-0f35-41ed-afb8-7810e36d5a6a tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8915c74c4d24d2cb1cded5aa7927120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc19bd60cde244559a823a47293540f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:25.002457 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-9b7f2cd6-0f35-41ed-afb8-7810e36d5a6a tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] 10.222.0.32 "GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e" status: 200 len: 1357 microversion: 2.1 time: 0.195768 May 30 12:11:25.003484 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 431/850] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:11:24 2022] GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e => generated 1357 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:11:25.358752 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-43c96f0a-7357-4f7e-863a-edd19ed84244 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:25.359365 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-43c96f0a-7357-4f7e-863a-edd19ed84244 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:25.366466 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-43c96f0a-7357-4f7e-863a-edd19ed84244 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:25.366921 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-43c96f0a-7357-4f7e-863a-edd19ed84244 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:25.367697 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-43c96f0a-7357-4f7e-863a-edd19ed84244 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:25.368137 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-43c96f0a-7357-4f7e-863a-edd19ed84244 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:25.511885 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-43c96f0a-7357-4f7e-863a-edd19ed84244 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:25.521834 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-43c96f0a-7357-4f7e-863a-edd19ed84244 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:25.523856 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-43c96f0a-7357-4f7e-863a-edd19ed84244 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:25.525120 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-43c96f0a-7357-4f7e-863a-edd19ed84244 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c" status: 200 len: 1722 microversion: 2.20 time: 0.170370 May 30 12:11:25.525783 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 420/851] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:11:25 2022] GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:11:25.732150 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-d3d8fe61-e7c6-480c-bcc6-503f431ed37e tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:25.732797 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-d3d8fe61-e7c6-480c-bcc6-503f431ed37e tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] [instance: 0fff5784-b25c-4dad-9826-af23b4f7658a] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:25.739386 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d3d8fe61-e7c6-480c-bcc6-503f431ed37e tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:25.740205 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d3d8fe61-e7c6-480c-bcc6-503f431ed37e tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:25.741222 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d3d8fe61-e7c6-480c-bcc6-503f431ed37e tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:25.741893 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d3d8fe61-e7c6-480c-bcc6-503f431ed37e tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:25.823126 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-d3d8fe61-e7c6-480c-bcc6-503f431ed37e tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f869410b53b14949a0f066e0e4163a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9ea0feaee34c639f228a4f320f1aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:25.831733 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-d3d8fe61-e7c6-480c-bcc6-503f431ed37e tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] 10.222.0.32 "GET /compute/v2.1/servers/0fff5784-b25c-4dad-9826-af23b4f7658a" status: 200 len: 1211 microversion: 2.1 time: 0.103449 May 30 12:11:25.832335 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 432/852] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:11:25 2022] GET /compute/v2.1/servers/0fff5784-b25c-4dad-9826-af23b4f7658a => generated 1211 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:11:26.021811 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-e5e60d05-e04c-4880-bbab-e16a638c0c1f tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:26.022424 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-e5e60d05-e04c-4880-bbab-e16a638c0c1f tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] [instance: 4eb46ab6-5aba-438a-b5d0-b04d6ddee02e] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:26.029638 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e5e60d05-e04c-4880-bbab-e16a638c0c1f tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:26.030083 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e5e60d05-e04c-4880-bbab-e16a638c0c1f tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:26.030853 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e5e60d05-e04c-4880-bbab-e16a638c0c1f tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:26.031286 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e5e60d05-e04c-4880-bbab-e16a638c0c1f tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:26.174210 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-e5e60d05-e04c-4880-bbab-e16a638c0c1f tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8915c74c4d24d2cb1cded5aa7927120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc19bd60cde244559a823a47293540f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:26.181846 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-e5e60d05-e04c-4880-bbab-e16a638c0c1f tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] 10.222.0.32 "GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e" status: 200 len: 1357 microversion: 2.1 time: 0.164848 May 30 12:11:26.182424 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 421/853] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:11:26 2022] GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:11:26.545174 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-55208d82-1ac2-4e5a-9621-302d2f8ca2c9 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:26.545796 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-55208d82-1ac2-4e5a-9621-302d2f8ca2c9 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:26.552185 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-55208d82-1ac2-4e5a-9621-302d2f8ca2c9 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:26.552646 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-55208d82-1ac2-4e5a-9621-302d2f8ca2c9 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:26.553425 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-55208d82-1ac2-4e5a-9621-302d2f8ca2c9 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:26.553863 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-55208d82-1ac2-4e5a-9621-302d2f8ca2c9 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:26.731604 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-55208d82-1ac2-4e5a-9621-302d2f8ca2c9 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:26.740395 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-55208d82-1ac2-4e5a-9621-302d2f8ca2c9 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:26.741899 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-55208d82-1ac2-4e5a-9621-302d2f8ca2c9 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:26.743070 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-55208d82-1ac2-4e5a-9621-302d2f8ca2c9 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c" status: 200 len: 1722 microversion: 2.20 time: 0.201839 May 30 12:11:26.743631 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 433/854] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:11:26 2022] GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c => generated 1722 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:11:26.848978 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-f6eb5c54-e4a8-450d-bd39-61b72cb31ee1 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:26.849597 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-f6eb5c54-e4a8-450d-bd39-61b72cb31ee1 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] [instance: 0fff5784-b25c-4dad-9826-af23b4f7658a] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:26.855737 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f6eb5c54-e4a8-450d-bd39-61b72cb31ee1 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:26.856189 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f6eb5c54-e4a8-450d-bd39-61b72cb31ee1 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:26.856967 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f6eb5c54-e4a8-450d-bd39-61b72cb31ee1 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:26.857404 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f6eb5c54-e4a8-450d-bd39-61b72cb31ee1 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:26.924399 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-f6eb5c54-e4a8-450d-bd39-61b72cb31ee1 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f869410b53b14949a0f066e0e4163a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9ea0feaee34c639f228a4f320f1aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:26.932175 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-f6eb5c54-e4a8-450d-bd39-61b72cb31ee1 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] 10.222.0.32 "GET /compute/v2.1/servers/0fff5784-b25c-4dad-9826-af23b4f7658a" status: 200 len: 1267 microversion: 2.1 time: 0.087891 May 30 12:11:26.932773 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 422/855] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:11:26 2022] GET /compute/v2.1/servers/0fff5784-b25c-4dad-9826-af23b4f7658a => generated 1267 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:11:27.199968 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-e14546f5-2417-4412-b3da-0783ab24c29f tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:27.201571 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-e14546f5-2417-4412-b3da-0783ab24c29f tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] [instance: 4eb46ab6-5aba-438a-b5d0-b04d6ddee02e] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:27.215345 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e14546f5-2417-4412-b3da-0783ab24c29f tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:27.216645 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e14546f5-2417-4412-b3da-0783ab24c29f tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:27.217784 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e14546f5-2417-4412-b3da-0783ab24c29f tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:27.218509 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e14546f5-2417-4412-b3da-0783ab24c29f tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:27.424797 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-e14546f5-2417-4412-b3da-0783ab24c29f tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8915c74c4d24d2cb1cded5aa7927120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc19bd60cde244559a823a47293540f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:27.434311 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-e14546f5-2417-4412-b3da-0783ab24c29f tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] 10.222.0.32 "GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e" status: 200 len: 1357 microversion: 2.1 time: 0.238905 May 30 12:11:27.443299 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 434/856] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:11:27 2022] GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e => generated 1357 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:11:27.763881 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-ba6c4424-f809-4de7-bb87-a2f5dd7621de tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:27.765263 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-ba6c4424-f809-4de7-bb87-a2f5dd7621de tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:27.776468 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ba6c4424-f809-4de7-bb87-a2f5dd7621de tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:27.778335 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ba6c4424-f809-4de7-bb87-a2f5dd7621de tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:27.779118 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ba6c4424-f809-4de7-bb87-a2f5dd7621de tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:27.779667 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ba6c4424-f809-4de7-bb87-a2f5dd7621de tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:27.950426 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-0b793cde-56b0-4181-ac54-6a46da92773b tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:27.951395 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-0b793cde-56b0-4181-ac54-6a46da92773b tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] [instance: 0fff5784-b25c-4dad-9826-af23b4f7658a] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:27.958932 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-ba6c4424-f809-4de7-bb87-a2f5dd7621de tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:27.959318 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0b793cde-56b0-4181-ac54-6a46da92773b tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:27.959991 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0b793cde-56b0-4181-ac54-6a46da92773b tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:27.961115 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0b793cde-56b0-4181-ac54-6a46da92773b tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:27.961780 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0b793cde-56b0-4181-ac54-6a46da92773b tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:27.968245 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-ba6c4424-f809-4de7-bb87-a2f5dd7621de tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:27.972208 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-ba6c4424-f809-4de7-bb87-a2f5dd7621de tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:27.973310 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-ba6c4424-f809-4de7-bb87-a2f5dd7621de tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c" status: 200 len: 1722 microversion: 2.20 time: 0.213613 May 30 12:11:27.982376 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 423/857] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:11:27 2022] GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c => generated 1722 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:11:28.037307 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-0b793cde-56b0-4181-ac54-6a46da92773b tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f869410b53b14949a0f066e0e4163a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9ea0feaee34c639f228a4f320f1aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:28.044961 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-0b793cde-56b0-4181-ac54-6a46da92773b tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] 10.222.0.32 "GET /compute/v2.1/servers/0fff5784-b25c-4dad-9826-af23b4f7658a" status: 200 len: 1273 microversion: 2.1 time: 0.099255 May 30 12:11:28.045697 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 435/858] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:11:27 2022] GET /compute/v2.1/servers/0fff5784-b25c-4dad-9826-af23b4f7658a => generated 1273 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:11:28.451637 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-6353c1ec-1f2f-42ed-971b-34b796b8ff38 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:28.452602 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-6353c1ec-1f2f-42ed-971b-34b796b8ff38 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] [instance: 4eb46ab6-5aba-438a-b5d0-b04d6ddee02e] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:28.462472 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6353c1ec-1f2f-42ed-971b-34b796b8ff38 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:28.462929 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6353c1ec-1f2f-42ed-971b-34b796b8ff38 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:28.463736 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6353c1ec-1f2f-42ed-971b-34b796b8ff38 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:28.468591 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6353c1ec-1f2f-42ed-971b-34b796b8ff38 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:28.649443 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-6353c1ec-1f2f-42ed-971b-34b796b8ff38 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8915c74c4d24d2cb1cded5aa7927120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc19bd60cde244559a823a47293540f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:28.659209 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-6353c1ec-1f2f-42ed-971b-34b796b8ff38 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] 10.222.0.32 "GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e" status: 200 len: 1357 microversion: 2.1 time: 0.211723 May 30 12:11:28.660370 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 424/859] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:11:28 2022] GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e => generated 1357 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:11:28.991737 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-79d83a41-73ce-4afd-92a7-2711d575d539 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:28.992399 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-79d83a41-73ce-4afd-92a7-2711d575d539 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:29.006205 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-79d83a41-73ce-4afd-92a7-2711d575d539 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:29.006660 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-79d83a41-73ce-4afd-92a7-2711d575d539 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:29.007457 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-79d83a41-73ce-4afd-92a7-2711d575d539 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:29.008078 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-79d83a41-73ce-4afd-92a7-2711d575d539 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:29.025678 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-1e274abb-81c3-4f00-9f26-0f7ac6e6d05b req-dd40faef-8c1c-4348-a03c-24137b09f0a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0614f5df-431f-4955-acdb-05894441016c", "name": "network-vif-deleted", "tag": "e2714e9d-b17a-42e1-8920-55a988a1b563"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:11:29.047179 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-1e274abb-81c3-4f00-9f26-0f7ac6e6d05b req-dd40faef-8c1c-4348-a03c-24137b09f0a1 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:29.048991 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-1e274abb-81c3-4f00-9f26-0f7ac6e6d05b req-dd40faef-8c1c-4348-a03c-24137b09f0a1 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:29.084730 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-1e274abb-81c3-4f00-9f26-0f7ac6e6d05b req-dd40faef-8c1c-4348-a03c-24137b09f0a1 service nova] Creating event network-vif-deleted:e2714e9d-b17a-42e1-8920-55a988a1b563 for instance 0614f5df-431f-4955-acdb-05894441016c on hv-cinder-84051 May 30 12:11:29.091322 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-1e274abb-81c3-4f00-9f26-0f7ac6e6d05b req-dd40faef-8c1c-4348-a03c-24137b09f0a1 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069552 May 30 12:11:29.096825 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 425/860] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:11:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 30 12:11:29.120608 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-7f3eb1f3-dd4e-45b7-9f31-512519177f25 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:29.121691 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-7f3eb1f3-dd4e-45b7-9f31-512519177f25 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] [instance: 0fff5784-b25c-4dad-9826-af23b4f7658a] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:29.143709 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7f3eb1f3-dd4e-45b7-9f31-512519177f25 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:29.144609 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7f3eb1f3-dd4e-45b7-9f31-512519177f25 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:29.145611 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7f3eb1f3-dd4e-45b7-9f31-512519177f25 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:29.146221 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7f3eb1f3-dd4e-45b7-9f31-512519177f25 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:29.182450 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-79d83a41-73ce-4afd-92a7-2711d575d539 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:29.192932 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-79d83a41-73ce-4afd-92a7-2711d575d539 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:29.195233 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-79d83a41-73ce-4afd-92a7-2711d575d539 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc47c5bf77894aefa6ecde115ed9f88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e98cc41e8064c90b0e45b32e2d78493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:29.200553 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-79d83a41-73ce-4afd-92a7-2711d575d539 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c" status: 200 len: 1655 microversion: 2.20 time: 0.212685 May 30 12:11:29.214701 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 436/861] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:11:28 2022] GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c => generated 1655 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:11:29.272597 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-7f3eb1f3-dd4e-45b7-9f31-512519177f25 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f869410b53b14949a0f066e0e4163a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9ea0feaee34c639f228a4f320f1aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:29.284353 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-7f3eb1f3-dd4e-45b7-9f31-512519177f25 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] 10.222.0.32 "GET /compute/v2.1/servers/0fff5784-b25c-4dad-9826-af23b4f7658a" status: 200 len: 1273 microversion: 2.1 time: 0.183084 May 30 12:11:29.286225 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 426/862] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:11:29 2022] GET /compute/v2.1/servers/0fff5784-b25c-4dad-9826-af23b4f7658a => generated 1273 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:11:29.678131 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-ff544f96-b68d-4477-aafe-046efa57efd2 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:29.678754 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-ff544f96-b68d-4477-aafe-046efa57efd2 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] [instance: 4eb46ab6-5aba-438a-b5d0-b04d6ddee02e] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:29.692382 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ff544f96-b68d-4477-aafe-046efa57efd2 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:29.693417 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ff544f96-b68d-4477-aafe-046efa57efd2 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:29.696071 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ff544f96-b68d-4477-aafe-046efa57efd2 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:29.697395 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ff544f96-b68d-4477-aafe-046efa57efd2 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:29.752606 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:11:29.943520 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-ff544f96-b68d-4477-aafe-046efa57efd2 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8915c74c4d24d2cb1cded5aa7927120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc19bd60cde244559a823a47293540f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:29.953962 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-ff544f96-b68d-4477-aafe-046efa57efd2 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] 10.222.0.32 "GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e" status: 200 len: 1357 microversion: 2.1 time: 0.280525 May 30 12:11:29.961322 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 437/863] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:11:29 2022] GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e => generated 1357 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:11:30.229064 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-0bbd3239-8881-4b1c-8c6b-e1cc06bbd95e tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:30.231736 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-0bbd3239-8881-4b1c-8c6b-e1cc06bbd95e tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:30.239986 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-0bbd3239-8881-4b1c-8c6b-e1cc06bbd95e tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:30.240552 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-0bbd3239-8881-4b1c-8c6b-e1cc06bbd95e tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:30.242696 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-0bbd3239-8881-4b1c-8c6b-e1cc06bbd95e tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:30.243434 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-0bbd3239-8881-4b1c-8c6b-e1cc06bbd95e tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:30.260508 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.wsgi [None req-0bbd3239-8881-4b1c-8c6b-e1cc06bbd95e tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] HTTP exception thrown: Instance 0614f5df-431f-4955-acdb-05894441016c could not be found. May 30 12:11:30.262535 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-0bbd3239-8881-4b1c-8c6b-e1cc06bbd95e tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Request method failure captured: May 30 12:11:30.262535 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: request: GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c HTTP/1.1 May 30 12:11:30.262535 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Accept: application/json May 30 12:11:30.262535 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Accept-Encoding: identity May 30 12:11:30.262535 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Connection: close May 30 12:11:30.262535 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Content-Length: 0 May 30 12:11:30.262535 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Content-Type: application/json May 30 12:11:30.262535 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Host: 10.222.0.32 May 30 12:11:30.262535 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Openstack-System-Scope: None May 30 12:11:30.262535 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: User-Agent: python-urllib3/1.26.9 May 30 12:11:30.262535 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Auth-Token: gAAAAABilLLI-jg3RotS7Wk43mDzzFxx0AOTox6SrMZQ2W86czASNqXFuxoVYDnJMcYhwpMGTnKCYVCopKaoURue3PP-yB4J0da2kvIVZIQxiR99ndktD6fHm8BTWt1aSZpv_MEGTOOpGL9UUj82swUqJ6QblDAt3ZJcoqLk6V0-Rlt3YtmTVQw May 30 12:11:30.262535 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Domain-Id: None May 30 12:11:30.262535 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Domain-Name: None May 30 12:11:30.262535 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Identity-Status: Confirmed May 30 12:11:30.262535 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Is-Admin-Project: True May 30 12:11:30.262535 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Openstack-Nova-Api-Version: 2.20 May 30 12:11:30.262535 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Domain-Id: default May 30 12:11:30.262535 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Domain-Name: Default May 30 12:11:30.262535 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Id: 8e98cc41e8064c90b0e45b32e2d78493 May 30 12:11:30.262535 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-704534015 May 30 12:11:30.262535 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Role: reader,member May 30 12:11:30.262535 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Roles: reader,member May 30 12:11:30.264358 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/8e98cc41e8064c90b0e45b32e2d78493"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/8e98cc41e8064c90b0e45b32e2d78493"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/8e98cc41e8064c90b0e45b32e2d78493"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_8e98cc41e8064c90b0e45b32e2d78493", "adminURL": "http://10.222.0.32:8080"}]}] May 30 12:11:30.264358 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant: tempest-AttachVolumeShelveTestJSON-704534015 May 30 12:11:30.264358 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant-Id: 8e98cc41e8064c90b0e45b32e2d78493 May 30 12:11:30.264358 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-704534015 May 30 12:11:30.264358 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User: tempest-AttachVolumeShelveTestJSON-704534015-project May 30 12:11:30.264358 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Domain-Id: default May 30 12:11:30.264358 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Domain-Name: Default May 30 12:11:30.264358 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Id: bc47c5bf77894aefa6ecde115ed9f88f May 30 12:11:30.264358 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Name: tempest-AttachVolumeShelveTestJSON-704534015-project May 30 12:11:30.264358 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: method: > May 30 12:11:30.264358 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: exception: Instance 0614f5df-431f-4955-acdb-05894441016c could not be found. May 30 12:11:30.264358 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: action_args: {'id': '0614f5df-431f-4955-acdb-05894441016c'} May 30 12:11:30.265679 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:11:30.265679 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:11:30.265679 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:11:30.265679 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:11:30.265679 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:11:30.265679 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:11:30.265679 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:11:30.265679 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:11:30.265679 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:11:30.265679 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:11:30.265679 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0614f5df-431f-4955-acdb-05894441016c could not be found. May 30 12:11:30.265679 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:11:30.265679 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:11:30.265679 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:11:30.265679 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:11:30.265679 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:11:30.265679 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:11:30.265679 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:11:30.265679 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:11:30.265679 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:11:30.268096 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:11:30.268096 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 30 12:11:30.268096 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 30 12:11:30.268096 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 30 12:11:30.268096 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 30 12:11:30.268096 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:11:30.268096 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:11:30.268096 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0614f5df-431f-4955-acdb-05894441016c could not be found. May 30 12:11:30.268096 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:11:30.268096 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:11:30.268096 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:11:30.268096 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:11:30.268096 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:11:30.268096 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:11:30.268096 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:11:30.268096 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:11:30.268096 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0614f5df-431f-4955-acdb-05894441016c could not be found. May 30 12:11:30.268096 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:11:30.270483 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-0bbd3239-8881-4b1c-8c6b-e1cc06bbd95e tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Returning 404 to user: Instance 0614f5df-431f-4955-acdb-05894441016c could not be found. {{(pid=117670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:11:30.272253 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-0bbd3239-8881-4b1c-8c6b-e1cc06bbd95e tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c" status: 404 len: 111 microversion: 2.20 time: 0.053150 May 30 12:11:30.273722 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 427/864] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:11:30 2022] GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 30 12:11:30.293073 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-cedd8e24-972e-436b-9b39-7c7892feefd6 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '.version_select at 0x7f0ef892bee0>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:30.304967 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-42b6f298-99d0-436e-8f45-3849586caa4a tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:30.305632 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-42b6f298-99d0-436e-8f45-3849586caa4a tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] [instance: 0fff5784-b25c-4dad-9826-af23b4f7658a] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:30.318395 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-42b6f298-99d0-436e-8f45-3849586caa4a tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:30.318852 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-42b6f298-99d0-436e-8f45-3849586caa4a tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:30.319645 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-42b6f298-99d0-436e-8f45-3849586caa4a tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:30.320084 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-42b6f298-99d0-436e-8f45-3849586caa4a tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:30.338380 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-cedd8e24-972e-436b-9b39-7c7892feefd6 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-489913905" status: 204 len: 0 microversion: 2.20 time: 0.054002 May 30 12:11:30.341576 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 438/865] 10.222.0.32 () {60 vars in 1258 bytes} [Mon May 30 12:11:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-489913905 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 30 12:11:30.358481 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell1:SELECT=100 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:11:30.600041 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-42b6f298-99d0-436e-8f45-3849586caa4a tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f869410b53b14949a0f066e0e4163a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9ea0feaee34c639f228a4f320f1aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:30.613247 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-42b6f298-99d0-436e-8f45-3849586caa4a tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] 10.222.0.32 "GET /compute/v2.1/servers/0fff5784-b25c-4dad-9826-af23b4f7658a" status: 200 len: 1315 microversion: 2.1 time: 0.313908 May 30 12:11:30.628242 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 428/866] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:11:30 2022] GET /compute/v2.1/servers/0fff5784-b25c-4dad-9826-af23b4f7658a => generated 1315 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:11:30.918171 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-36aa22a6-b6d7-47c6-bb4e-97e9ee49ec6e req-e29fc02c-1ae1-4d1e-acd5-4fe13c61555c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eb46ab6-5aba-438a-b5d0-b04d6ddee02e", "name": "network-vif-plugged", "status": "completed", "tag": "a3736af0-e6ce-4bc1-adc2-3c3c8417fdb9"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:11:30.935153 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-36aa22a6-b6d7-47c6-bb4e-97e9ee49ec6e req-e29fc02c-1ae1-4d1e-acd5-4fe13c61555c service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:30.935418 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-36aa22a6-b6d7-47c6-bb4e-97e9ee49ec6e req-e29fc02c-1ae1-4d1e-acd5-4fe13c61555c service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:30.950770 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-36aa22a6-b6d7-47c6-bb4e-97e9ee49ec6e req-e29fc02c-1ae1-4d1e-acd5-4fe13c61555c service nova] Creating event network-vif-plugged:a3736af0-e6ce-4bc1-adc2-3c3c8417fdb9 for instance 4eb46ab6-5aba-438a-b5d0-b04d6ddee02e on hv-cinder-84051 May 30 12:11:30.956704 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-36aa22a6-b6d7-47c6-bb4e-97e9ee49ec6e req-e29fc02c-1ae1-4d1e-acd5-4fe13c61555c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042784 May 30 12:11:30.957885 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 439/867] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:11:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:11:30.976810 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-8c932016-4741-4dfd-8af4-5dd27d0a46ca tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:30.977635 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-8c932016-4741-4dfd-8af4-5dd27d0a46ca tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] [instance: 4eb46ab6-5aba-438a-b5d0-b04d6ddee02e] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:30.996651 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8c932016-4741-4dfd-8af4-5dd27d0a46ca tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:31.000514 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8c932016-4741-4dfd-8af4-5dd27d0a46ca tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:31.004358 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8c932016-4741-4dfd-8af4-5dd27d0a46ca tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:31.005252 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8c932016-4741-4dfd-8af4-5dd27d0a46ca tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:31.121903 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell0:SELECT=2 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:11:31.128432 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-7d54fb80-ac19-48fb-99f2-c36a1dca7a57 req-b2399001-8c73-41e9-a96f-f0407081f144 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fff5784-b25c-4dad-9826-af23b4f7658a", "tag": "88273239-7077-4f3d-b530-e64d6b1c2ba3"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:11:31.146528 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-7d54fb80-ac19-48fb-99f2-c36a1dca7a57 req-b2399001-8c73-41e9-a96f-f0407081f144 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:31.147441 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-7d54fb80-ac19-48fb-99f2-c36a1dca7a57 req-b2399001-8c73-41e9-a96f-f0407081f144 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:31.165760 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-7d54fb80-ac19-48fb-99f2-c36a1dca7a57 req-b2399001-8c73-41e9-a96f-f0407081f144 service nova] Creating event network-changed:88273239-7077-4f3d-b530-e64d6b1c2ba3 for instance 0fff5784-b25c-4dad-9826-af23b4f7658a on hv-cinder-84051 May 30 12:11:31.170374 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-7d54fb80-ac19-48fb-99f2-c36a1dca7a57 req-b2399001-8c73-41e9-a96f-f0407081f144 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049238 May 30 12:11:31.174863 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 440/868] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:11:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 30 12:11:31.288890 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-8c932016-4741-4dfd-8af4-5dd27d0a46ca tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8915c74c4d24d2cb1cded5aa7927120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc19bd60cde244559a823a47293540f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:31.299037 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-8c932016-4741-4dfd-8af4-5dd27d0a46ca tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] 10.222.0.32 "GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e" status: 200 len: 1357 microversion: 2.1 time: 0.331104 May 30 12:11:31.300059 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 429/869] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:11:30 2022] GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e => generated 1357 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:11:31.628227 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell0:SELECT=14 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:11:31.633130 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-3fcba772-eee3-484f-b8df-77816746e905 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:31.633844 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-3fcba772-eee3-484f-b8df-77816746e905 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] [instance: 0fff5784-b25c-4dad-9826-af23b4f7658a] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:31.640755 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3fcba772-eee3-484f-b8df-77816746e905 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:31.641203 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3fcba772-eee3-484f-b8df-77816746e905 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:31.641988 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3fcba772-eee3-484f-b8df-77816746e905 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:31.642474 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3fcba772-eee3-484f-b8df-77816746e905 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:31.784550 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-3fcba772-eee3-484f-b8df-77816746e905 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f869410b53b14949a0f066e0e4163a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9ea0feaee34c639f228a4f320f1aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:31.792017 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-3fcba772-eee3-484f-b8df-77816746e905 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] 10.222.0.32 "GET /compute/v2.1/servers/0fff5784-b25c-4dad-9826-af23b4f7658a" status: 200 len: 1315 microversion: 2.1 time: 0.165710 May 30 12:11:31.792603 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 441/870] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:11:31 2022] GET /compute/v2.1/servers/0fff5784-b25c-4dad-9826-af23b4f7658a => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:11:32.316397 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-b1546e98-56e8-4c3d-81e1-124d4dbeabd1 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:32.317016 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-b1546e98-56e8-4c3d-81e1-124d4dbeabd1 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] [instance: 4eb46ab6-5aba-438a-b5d0-b04d6ddee02e] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:32.324650 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b1546e98-56e8-4c3d-81e1-124d4dbeabd1 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:32.325099 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b1546e98-56e8-4c3d-81e1-124d4dbeabd1 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:32.325884 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b1546e98-56e8-4c3d-81e1-124d4dbeabd1 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:32.326313 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b1546e98-56e8-4c3d-81e1-124d4dbeabd1 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:32.475450 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-b1546e98-56e8-4c3d-81e1-124d4dbeabd1 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8915c74c4d24d2cb1cded5aa7927120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc19bd60cde244559a823a47293540f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:32.486006 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-b1546e98-56e8-4c3d-81e1-124d4dbeabd1 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] 10.222.0.32 "GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e" status: 200 len: 1357 microversion: 2.1 time: 0.173820 May 30 12:11:32.488292 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 430/871] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:11:32 2022] GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e => generated 1357 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:11:32.604592 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-28c2fdd9-1fc2-44fb-b4ce-a265f0b184d7 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:32.605490 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-28c2fdd9-1fc2-44fb-b4ce-a265f0b184d7 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:32.612429 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-28c2fdd9-1fc2-44fb-b4ce-a265f0b184d7 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:32.613116 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-28c2fdd9-1fc2-44fb-b4ce-a265f0b184d7 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:32.614030 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-28c2fdd9-1fc2-44fb-b4ce-a265f0b184d7 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:32.614769 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-28c2fdd9-1fc2-44fb-b4ce-a265f0b184d7 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:32.633462 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.wsgi [None req-28c2fdd9-1fc2-44fb-b4ce-a265f0b184d7 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] HTTP exception thrown: Instance 0614f5df-431f-4955-acdb-05894441016c could not be found. May 30 12:11:32.635414 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-28c2fdd9-1fc2-44fb-b4ce-a265f0b184d7 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Request method failure captured: May 30 12:11:32.635414 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: request: DELETE /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c HTTP/1.1 May 30 12:11:32.635414 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Accept: application/json May 30 12:11:32.635414 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Accept-Encoding: identity May 30 12:11:32.635414 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Connection: close May 30 12:11:32.635414 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Content-Length: 0 May 30 12:11:32.635414 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Content-Type: application/json May 30 12:11:32.635414 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Host: 10.222.0.32 May 30 12:11:32.635414 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Openstack-System-Scope: None May 30 12:11:32.635414 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: User-Agent: python-urllib3/1.26.9 May 30 12:11:32.635414 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Auth-Token: gAAAAABilLLI-jg3RotS7Wk43mDzzFxx0AOTox6SrMZQ2W86czASNqXFuxoVYDnJMcYhwpMGTnKCYVCopKaoURue3PP-yB4J0da2kvIVZIQxiR99ndktD6fHm8BTWt1aSZpv_MEGTOOpGL9UUj82swUqJ6QblDAt3ZJcoqLk6V0-Rlt3YtmTVQw May 30 12:11:32.635414 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Domain-Id: None May 30 12:11:32.635414 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Domain-Name: None May 30 12:11:32.635414 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Identity-Status: Confirmed May 30 12:11:32.635414 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Is-Admin-Project: True May 30 12:11:32.635414 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Openstack-Nova-Api-Version: 2.20 May 30 12:11:32.635414 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Domain-Id: default May 30 12:11:32.635414 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Domain-Name: Default May 30 12:11:32.635414 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Id: 8e98cc41e8064c90b0e45b32e2d78493 May 30 12:11:32.635414 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-704534015 May 30 12:11:32.635414 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Role: reader,member May 30 12:11:32.635414 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Roles: reader,member May 30 12:11:32.637125 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/8e98cc41e8064c90b0e45b32e2d78493"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/8e98cc41e8064c90b0e45b32e2d78493"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/8e98cc41e8064c90b0e45b32e2d78493"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_8e98cc41e8064c90b0e45b32e2d78493", "adminURL": "http://10.222.0.32:8080"}]}] May 30 12:11:32.637125 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Tenant: tempest-AttachVolumeShelveTestJSON-704534015 May 30 12:11:32.637125 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Tenant-Id: 8e98cc41e8064c90b0e45b32e2d78493 May 30 12:11:32.637125 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-704534015 May 30 12:11:32.637125 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User: tempest-AttachVolumeShelveTestJSON-704534015-project May 30 12:11:32.637125 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Domain-Id: default May 30 12:11:32.637125 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Domain-Name: Default May 30 12:11:32.637125 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Id: bc47c5bf77894aefa6ecde115ed9f88f May 30 12:11:32.637125 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Name: tempest-AttachVolumeShelveTestJSON-704534015-project May 30 12:11:32.637125 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: method: > May 30 12:11:32.637125 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: exception: Instance 0614f5df-431f-4955-acdb-05894441016c could not be found. May 30 12:11:32.637125 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: action_args: {'id': '0614f5df-431f-4955-acdb-05894441016c'} May 30 12:11:32.638053 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:11:32.638053 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:11:32.638053 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:11:32.638053 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:11:32.638053 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:11:32.638053 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:11:32.638053 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:11:32.638053 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:11:32.638053 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:11:32.638053 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:11:32.638053 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0614f5df-431f-4955-acdb-05894441016c could not be found. May 30 12:11:32.638053 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:11:32.638053 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:11:32.638053 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:11:32.638053 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:11:32.638053 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:11:32.638053 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:11:32.638053 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:11:32.638053 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:11:32.638053 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:11:32.639514 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:11:32.639514 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 30 12:11:32.639514 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 30 12:11:32.639514 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 30 12:11:32.639514 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 30 12:11:32.639514 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 30 12:11:32.639514 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 30 12:11:32.639514 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:11:32.639514 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:11:32.639514 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0614f5df-431f-4955-acdb-05894441016c could not be found. May 30 12:11:32.639514 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:11:32.639514 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:11:32.639514 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:11:32.639514 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:11:32.639514 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:11:32.639514 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:11:32.639514 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:11:32.639514 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:11:32.639514 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0614f5df-431f-4955-acdb-05894441016c could not be found. May 30 12:11:32.639514 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:11:32.643139 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-28c2fdd9-1fc2-44fb-b4ce-a265f0b184d7 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Returning 404 to user: Instance 0614f5df-431f-4955-acdb-05894441016c could not be found. {{(pid=117671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:11:32.643139 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-28c2fdd9-1fc2-44fb-b4ce-a265f0b184d7 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "DELETE /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c" status: 404 len: 111 microversion: 2.20 time: 0.036875 May 30 12:11:32.643139 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 442/872] 10.222.0.32 () {60 vars in 1279 bytes} [Mon May 30 12:11:32 2022] DELETE /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 30 12:11:32.649232 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-d01c6bc3-ecc0-47bf-9586-d28d86ee707d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:32.649858 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-d01c6bc3-ecc0-47bf-9586-d28d86ee707d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 0614f5df-431f-4955-acdb-05894441016c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:32.656033 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d01c6bc3-ecc0-47bf-9586-d28d86ee707d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:32.656518 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d01c6bc3-ecc0-47bf-9586-d28d86ee707d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:32.657294 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d01c6bc3-ecc0-47bf-9586-d28d86ee707d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:32.657870 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d01c6bc3-ecc0-47bf-9586-d28d86ee707d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:32.671783 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.wsgi [None req-d01c6bc3-ecc0-47bf-9586-d28d86ee707d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] HTTP exception thrown: Instance 0614f5df-431f-4955-acdb-05894441016c could not be found. May 30 12:11:32.673362 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-d01c6bc3-ecc0-47bf-9586-d28d86ee707d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Request method failure captured: May 30 12:11:32.673362 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: request: GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c HTTP/1.1 May 30 12:11:32.673362 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Accept: application/json May 30 12:11:32.673362 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Accept-Encoding: identity May 30 12:11:32.673362 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Connection: close May 30 12:11:32.673362 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Content-Length: 0 May 30 12:11:32.673362 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Content-Type: application/json May 30 12:11:32.673362 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Host: 10.222.0.32 May 30 12:11:32.673362 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Openstack-System-Scope: None May 30 12:11:32.673362 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: User-Agent: python-urllib3/1.26.9 May 30 12:11:32.673362 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Auth-Token: gAAAAABilLLI-jg3RotS7Wk43mDzzFxx0AOTox6SrMZQ2W86czASNqXFuxoVYDnJMcYhwpMGTnKCYVCopKaoURue3PP-yB4J0da2kvIVZIQxiR99ndktD6fHm8BTWt1aSZpv_MEGTOOpGL9UUj82swUqJ6QblDAt3ZJcoqLk6V0-Rlt3YtmTVQw May 30 12:11:32.673362 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Domain-Id: None May 30 12:11:32.673362 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Domain-Name: None May 30 12:11:32.673362 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Identity-Status: Confirmed May 30 12:11:32.673362 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Is-Admin-Project: True May 30 12:11:32.673362 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Openstack-Nova-Api-Version: 2.20 May 30 12:11:32.673362 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Domain-Id: default May 30 12:11:32.673362 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Domain-Name: Default May 30 12:11:32.673362 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Id: 8e98cc41e8064c90b0e45b32e2d78493 May 30 12:11:32.673362 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-704534015 May 30 12:11:32.673362 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Role: reader,member May 30 12:11:32.673362 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Roles: reader,member May 30 12:11:32.675551 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/8e98cc41e8064c90b0e45b32e2d78493"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/8e98cc41e8064c90b0e45b32e2d78493"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/8e98cc41e8064c90b0e45b32e2d78493"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_8e98cc41e8064c90b0e45b32e2d78493", "adminURL": "http://10.222.0.32:8080"}]}] May 30 12:11:32.675551 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant: tempest-AttachVolumeShelveTestJSON-704534015 May 30 12:11:32.675551 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant-Id: 8e98cc41e8064c90b0e45b32e2d78493 May 30 12:11:32.675551 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-704534015 May 30 12:11:32.675551 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User: tempest-AttachVolumeShelveTestJSON-704534015-project May 30 12:11:32.675551 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Domain-Id: default May 30 12:11:32.675551 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Domain-Name: Default May 30 12:11:32.675551 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Id: bc47c5bf77894aefa6ecde115ed9f88f May 30 12:11:32.675551 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Name: tempest-AttachVolumeShelveTestJSON-704534015-project May 30 12:11:32.675551 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: method: > May 30 12:11:32.675551 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: exception: Instance 0614f5df-431f-4955-acdb-05894441016c could not be found. May 30 12:11:32.675551 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: action_args: {'id': '0614f5df-431f-4955-acdb-05894441016c'} May 30 12:11:32.676502 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:11:32.676502 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:11:32.676502 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:11:32.676502 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:11:32.676502 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:11:32.676502 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:11:32.676502 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:11:32.676502 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:11:32.676502 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:11:32.676502 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:11:32.676502 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0614f5df-431f-4955-acdb-05894441016c could not be found. May 30 12:11:32.676502 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:11:32.676502 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:11:32.676502 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:11:32.676502 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:11:32.676502 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:11:32.676502 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:11:32.676502 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:11:32.676502 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:11:32.676502 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:11:32.678329 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:11:32.678329 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 30 12:11:32.678329 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 30 12:11:32.678329 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 30 12:11:32.678329 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 30 12:11:32.678329 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:11:32.678329 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:11:32.678329 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0614f5df-431f-4955-acdb-05894441016c could not be found. May 30 12:11:32.678329 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:11:32.678329 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:11:32.678329 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:11:32.678329 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:11:32.678329 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:11:32.678329 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:11:32.678329 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:11:32.678329 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:11:32.678329 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0614f5df-431f-4955-acdb-05894441016c could not be found. May 30 12:11:32.678329 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:11:32.679737 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-d01c6bc3-ecc0-47bf-9586-d28d86ee707d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Returning 404 to user: Instance 0614f5df-431f-4955-acdb-05894441016c could not be found. {{(pid=117670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:11:32.679737 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-d01c6bc3-ecc0-47bf-9586-d28d86ee707d tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c" status: 404 len: 111 microversion: 2.20 time: 0.029549 May 30 12:11:32.679737 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 431/873] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:11:32 2022] GET /compute/v2.1/servers/0614f5df-431f-4955-acdb-05894441016c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 30 12:11:32.809370 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-dfd63296-c3bb-4013-8bd4-f992ae1937ca tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:32.810020 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-dfd63296-c3bb-4013-8bd4-f992ae1937ca tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] [instance: 0fff5784-b25c-4dad-9826-af23b4f7658a] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:32.816702 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-dfd63296-c3bb-4013-8bd4-f992ae1937ca tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:32.817148 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-dfd63296-c3bb-4013-8bd4-f992ae1937ca tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:32.817916 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-dfd63296-c3bb-4013-8bd4-f992ae1937ca tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:32.818351 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-dfd63296-c3bb-4013-8bd4-f992ae1937ca tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:32.958383 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-dfd63296-c3bb-4013-8bd4-f992ae1937ca tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f869410b53b14949a0f066e0e4163a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9ea0feaee34c639f228a4f320f1aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:32.965875 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-dfd63296-c3bb-4013-8bd4-f992ae1937ca tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] 10.222.0.32 "GET /compute/v2.1/servers/0fff5784-b25c-4dad-9826-af23b4f7658a" status: 200 len: 1315 microversion: 2.1 time: 0.160347 May 30 12:11:32.966438 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 443/874] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:11:32 2022] GET /compute/v2.1/servers/0fff5784-b25c-4dad-9826-af23b4f7658a => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:11:33.504949 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-51bafb77-2767-448c-8631-9051788f5a47 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:33.505478 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-51bafb77-2767-448c-8631-9051788f5a47 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] [instance: 4eb46ab6-5aba-438a-b5d0-b04d6ddee02e] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:33.511981 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-51bafb77-2767-448c-8631-9051788f5a47 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:33.512460 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-51bafb77-2767-448c-8631-9051788f5a47 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:33.513227 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-51bafb77-2767-448c-8631-9051788f5a47 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:33.513660 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-51bafb77-2767-448c-8631-9051788f5a47 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:33.660662 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-51bafb77-2767-448c-8631-9051788f5a47 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8915c74c4d24d2cb1cded5aa7927120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc19bd60cde244559a823a47293540f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:33.669840 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-51bafb77-2767-448c-8631-9051788f5a47 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] 10.222.0.32 "GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e" status: 200 len: 1357 microversion: 2.1 time: 0.169000 May 30 12:11:33.670422 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 432/875] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:11:33 2022] GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:11:33.822654 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-d22a7393-135b-425f-9cb0-73ee0aa01832 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:33.823228 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-d22a7393-135b-425f-9cb0-73ee0aa01832 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:33.831147 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d22a7393-135b-425f-9cb0-73ee0aa01832 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:33.831958 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d22a7393-135b-425f-9cb0-73ee0aa01832 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:33.832796 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d22a7393-135b-425f-9cb0-73ee0aa01832 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:33.833287 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d22a7393-135b-425f-9cb0-73ee0aa01832 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:33.848715 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.wsgi [None req-d22a7393-135b-425f-9cb0-73ee0aa01832 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] HTTP exception thrown: Instance 314658c0-2ad4-4987-99bc-f8acf2d7e46c could not be found. May 30 12:11:33.850271 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-d22a7393-135b-425f-9cb0-73ee0aa01832 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Request method failure captured: May 30 12:11:33.850271 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: request: DELETE /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c HTTP/1.1 May 30 12:11:33.850271 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Accept: application/json May 30 12:11:33.850271 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Accept-Encoding: identity May 30 12:11:33.850271 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Connection: close May 30 12:11:33.850271 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Content-Length: 0 May 30 12:11:33.850271 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Content-Type: application/json May 30 12:11:33.850271 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Host: 10.222.0.32 May 30 12:11:33.850271 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Openstack-System-Scope: None May 30 12:11:33.850271 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: User-Agent: python-urllib3/1.26.9 May 30 12:11:33.850271 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Auth-Token: gAAAAABilLLI-jg3RotS7Wk43mDzzFxx0AOTox6SrMZQ2W86czASNqXFuxoVYDnJMcYhwpMGTnKCYVCopKaoURue3PP-yB4J0da2kvIVZIQxiR99ndktD6fHm8BTWt1aSZpv_MEGTOOpGL9UUj82swUqJ6QblDAt3ZJcoqLk6V0-Rlt3YtmTVQw May 30 12:11:33.850271 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Domain-Id: None May 30 12:11:33.850271 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Domain-Name: None May 30 12:11:33.850271 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Identity-Status: Confirmed May 30 12:11:33.850271 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Is-Admin-Project: True May 30 12:11:33.850271 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Openstack-Nova-Api-Version: 2.20 May 30 12:11:33.850271 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Domain-Id: default May 30 12:11:33.850271 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Domain-Name: Default May 30 12:11:33.850271 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Id: 8e98cc41e8064c90b0e45b32e2d78493 May 30 12:11:33.850271 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-704534015 May 30 12:11:33.850271 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Role: reader,member May 30 12:11:33.850271 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Roles: reader,member May 30 12:11:33.851845 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/8e98cc41e8064c90b0e45b32e2d78493"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/8e98cc41e8064c90b0e45b32e2d78493"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/8e98cc41e8064c90b0e45b32e2d78493"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_8e98cc41e8064c90b0e45b32e2d78493", "adminURL": "http://10.222.0.32:8080"}]}] May 30 12:11:33.851845 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Tenant: tempest-AttachVolumeShelveTestJSON-704534015 May 30 12:11:33.851845 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Tenant-Id: 8e98cc41e8064c90b0e45b32e2d78493 May 30 12:11:33.851845 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-704534015 May 30 12:11:33.851845 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User: tempest-AttachVolumeShelveTestJSON-704534015-project May 30 12:11:33.851845 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Domain-Id: default May 30 12:11:33.851845 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Domain-Name: Default May 30 12:11:33.851845 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Id: bc47c5bf77894aefa6ecde115ed9f88f May 30 12:11:33.851845 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Name: tempest-AttachVolumeShelveTestJSON-704534015-project May 30 12:11:33.851845 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: method: > May 30 12:11:33.851845 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: exception: Instance 314658c0-2ad4-4987-99bc-f8acf2d7e46c could not be found. May 30 12:11:33.851845 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: action_args: {'id': '314658c0-2ad4-4987-99bc-f8acf2d7e46c'} May 30 12:11:33.853190 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:11:33.853190 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:11:33.853190 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:11:33.853190 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:11:33.853190 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:11:33.853190 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:11:33.853190 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:11:33.853190 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:11:33.853190 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:11:33.853190 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:11:33.853190 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 314658c0-2ad4-4987-99bc-f8acf2d7e46c could not be found. May 30 12:11:33.853190 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:11:33.853190 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:11:33.853190 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:11:33.853190 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:11:33.853190 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:11:33.853190 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:11:33.853190 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:11:33.853190 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:11:33.853190 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:11:33.854645 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:11:33.854645 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 30 12:11:33.854645 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 30 12:11:33.854645 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 30 12:11:33.854645 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 30 12:11:33.854645 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 30 12:11:33.854645 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 30 12:11:33.854645 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:11:33.854645 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:11:33.854645 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 314658c0-2ad4-4987-99bc-f8acf2d7e46c could not be found. May 30 12:11:33.854645 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:11:33.854645 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:11:33.854645 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:11:33.854645 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:11:33.854645 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:11:33.854645 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:11:33.854645 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:11:33.854645 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:11:33.854645 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 314658c0-2ad4-4987-99bc-f8acf2d7e46c could not be found. May 30 12:11:33.854645 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:11:33.856743 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-d22a7393-135b-425f-9cb0-73ee0aa01832 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Returning 404 to user: Instance 314658c0-2ad4-4987-99bc-f8acf2d7e46c could not be found. {{(pid=117671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:11:33.857583 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-d22a7393-135b-425f-9cb0-73ee0aa01832 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "DELETE /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 404 len: 111 microversion: 2.20 time: 0.038880 May 30 12:11:33.858323 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 444/876] 10.222.0.32 () {60 vars in 1279 bytes} [Mon May 30 12:11:33 2022] DELETE /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 30 12:11:33.866203 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-6bf92f3c-f56e-429a-ad80-3d5dd80b91e1 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:33.866817 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-6bf92f3c-f56e-429a-ad80-3d5dd80b91e1 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] [instance: 314658c0-2ad4-4987-99bc-f8acf2d7e46c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:33.873551 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6bf92f3c-f56e-429a-ad80-3d5dd80b91e1 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:33.873992 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6bf92f3c-f56e-429a-ad80-3d5dd80b91e1 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:33.874769 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6bf92f3c-f56e-429a-ad80-3d5dd80b91e1 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:33.875390 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6bf92f3c-f56e-429a-ad80-3d5dd80b91e1 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:33.890287 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.wsgi [None req-6bf92f3c-f56e-429a-ad80-3d5dd80b91e1 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] HTTP exception thrown: Instance 314658c0-2ad4-4987-99bc-f8acf2d7e46c could not be found. May 30 12:11:33.891855 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-6bf92f3c-f56e-429a-ad80-3d5dd80b91e1 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Request method failure captured: May 30 12:11:33.891855 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: request: GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c HTTP/1.1 May 30 12:11:33.891855 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Accept: application/json May 30 12:11:33.891855 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Accept-Encoding: identity May 30 12:11:33.891855 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Connection: close May 30 12:11:33.891855 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Content-Length: 0 May 30 12:11:33.891855 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Content-Type: application/json May 30 12:11:33.891855 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Host: 10.222.0.32 May 30 12:11:33.891855 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Openstack-System-Scope: None May 30 12:11:33.891855 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: User-Agent: python-urllib3/1.26.9 May 30 12:11:33.891855 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Auth-Token: gAAAAABilLLI-jg3RotS7Wk43mDzzFxx0AOTox6SrMZQ2W86czASNqXFuxoVYDnJMcYhwpMGTnKCYVCopKaoURue3PP-yB4J0da2kvIVZIQxiR99ndktD6fHm8BTWt1aSZpv_MEGTOOpGL9UUj82swUqJ6QblDAt3ZJcoqLk6V0-Rlt3YtmTVQw May 30 12:11:33.891855 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Domain-Id: None May 30 12:11:33.891855 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Domain-Name: None May 30 12:11:33.891855 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Identity-Status: Confirmed May 30 12:11:33.891855 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Is-Admin-Project: True May 30 12:11:33.891855 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Openstack-Nova-Api-Version: 2.20 May 30 12:11:33.891855 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Domain-Id: default May 30 12:11:33.891855 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Domain-Name: Default May 30 12:11:33.891855 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Id: 8e98cc41e8064c90b0e45b32e2d78493 May 30 12:11:33.891855 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-704534015 May 30 12:11:33.891855 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Role: reader,member May 30 12:11:33.891855 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Roles: reader,member May 30 12:11:33.894467 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/8e98cc41e8064c90b0e45b32e2d78493"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/8e98cc41e8064c90b0e45b32e2d78493"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/8e98cc41e8064c90b0e45b32e2d78493"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_8e98cc41e8064c90b0e45b32e2d78493", "adminURL": "http://10.222.0.32:8080"}]}] May 30 12:11:33.894467 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant: tempest-AttachVolumeShelveTestJSON-704534015 May 30 12:11:33.894467 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant-Id: 8e98cc41e8064c90b0e45b32e2d78493 May 30 12:11:33.894467 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-704534015 May 30 12:11:33.894467 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User: tempest-AttachVolumeShelveTestJSON-704534015-project May 30 12:11:33.894467 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Domain-Id: default May 30 12:11:33.894467 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Domain-Name: Default May 30 12:11:33.894467 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Id: bc47c5bf77894aefa6ecde115ed9f88f May 30 12:11:33.894467 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Name: tempest-AttachVolumeShelveTestJSON-704534015-project May 30 12:11:33.894467 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: method: > May 30 12:11:33.894467 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: exception: Instance 314658c0-2ad4-4987-99bc-f8acf2d7e46c could not be found. May 30 12:11:33.894467 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: action_args: {'id': '314658c0-2ad4-4987-99bc-f8acf2d7e46c'} May 30 12:11:33.895342 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:11:33.895342 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:11:33.895342 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:11:33.895342 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:11:33.895342 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:11:33.895342 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:11:33.895342 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:11:33.895342 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:11:33.895342 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:11:33.895342 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:11:33.895342 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 314658c0-2ad4-4987-99bc-f8acf2d7e46c could not be found. May 30 12:11:33.895342 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:11:33.895342 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:11:33.895342 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:11:33.895342 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:11:33.895342 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:11:33.895342 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:11:33.895342 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:11:33.895342 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:11:33.895342 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:11:33.896766 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:11:33.896766 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 30 12:11:33.896766 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 30 12:11:33.896766 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 30 12:11:33.896766 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 30 12:11:33.896766 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:11:33.896766 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:11:33.896766 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 314658c0-2ad4-4987-99bc-f8acf2d7e46c could not be found. May 30 12:11:33.896766 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:11:33.896766 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:11:33.896766 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:11:33.896766 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:11:33.896766 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:11:33.896766 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:11:33.896766 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:11:33.896766 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:11:33.896766 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 314658c0-2ad4-4987-99bc-f8acf2d7e46c could not be found. May 30 12:11:33.896766 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:11:33.898133 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-6bf92f3c-f56e-429a-ad80-3d5dd80b91e1 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] Returning 404 to user: Instance 314658c0-2ad4-4987-99bc-f8acf2d7e46c could not be found. {{(pid=117670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:11:33.898133 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-6bf92f3c-f56e-429a-ad80-3d5dd80b91e1 tempest-AttachVolumeShelveTestJSON-704534015 tempest-AttachVolumeShelveTestJSON-704534015-project] 10.222.0.32 "GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c" status: 404 len: 111 microversion: 2.20 time: 0.031853 May 30 12:11:33.898133 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 433/877] 10.222.0.32 () {60 vars in 1276 bytes} [Mon May 30 12:11:33 2022] GET /compute/v2.1/servers/314658c0-2ad4-4987-99bc-f8acf2d7e46c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 30 12:11:33.985270 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-ff712ec7-b6af-4e82-b706-32e4561a2ff5 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:33.986184 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-ff712ec7-b6af-4e82-b706-32e4561a2ff5 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] [instance: 0fff5784-b25c-4dad-9826-af23b4f7658a] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:33.993471 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ff712ec7-b6af-4e82-b706-32e4561a2ff5 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:33.993940 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ff712ec7-b6af-4e82-b706-32e4561a2ff5 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:33.994734 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ff712ec7-b6af-4e82-b706-32e4561a2ff5 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:33.995162 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ff712ec7-b6af-4e82-b706-32e4561a2ff5 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:34.490166 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-ff712ec7-b6af-4e82-b706-32e4561a2ff5 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f869410b53b14949a0f066e0e4163a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9ea0feaee34c639f228a4f320f1aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:34.498829 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-ff712ec7-b6af-4e82-b706-32e4561a2ff5 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] 10.222.0.32 "GET /compute/v2.1/servers/0fff5784-b25c-4dad-9826-af23b4f7658a" status: 200 len: 1315 microversion: 2.1 time: 0.519597 May 30 12:11:34.506513 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 445/878] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:11:33 2022] GET /compute/v2.1/servers/0fff5784-b25c-4dad-9826-af23b4f7658a => generated 1315 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:11:34.694618 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-c07465c4-28d4-4f46-9bfe-8e7379b78f42 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:34.697992 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-c07465c4-28d4-4f46-9bfe-8e7379b78f42 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] [instance: 4eb46ab6-5aba-438a-b5d0-b04d6ddee02e] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:34.711546 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c07465c4-28d4-4f46-9bfe-8e7379b78f42 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:34.712095 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c07465c4-28d4-4f46-9bfe-8e7379b78f42 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:34.713664 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c07465c4-28d4-4f46-9bfe-8e7379b78f42 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:34.714109 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c07465c4-28d4-4f46-9bfe-8e7379b78f42 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:35.014280 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-c07465c4-28d4-4f46-9bfe-8e7379b78f42 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8915c74c4d24d2cb1cded5aa7927120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc19bd60cde244559a823a47293540f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:35.024720 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-c07465c4-28d4-4f46-9bfe-8e7379b78f42 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] 10.222.0.32 "GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e" status: 200 len: 1547 microversion: 2.1 time: 0.341098 May 30 12:11:35.036230 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 434/879] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:11:34 2022] GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e => generated 1547 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:11:35.042176 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-2bf46b08-3469-4129-bf53-a3104d4b3723 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:35.042942 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-2bf46b08-3469-4129-bf53-a3104d4b3723 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] [instance: 4eb46ab6-5aba-438a-b5d0-b04d6ddee02e] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:35.052226 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2bf46b08-3469-4129-bf53-a3104d4b3723 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:35.052817 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2bf46b08-3469-4129-bf53-a3104d4b3723 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:35.053748 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2bf46b08-3469-4129-bf53-a3104d4b3723 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:35.054275 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2bf46b08-3469-4129-bf53-a3104d4b3723 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:35.351634 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-2bf46b08-3469-4129-bf53-a3104d4b3723 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8915c74c4d24d2cb1cded5aa7927120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc19bd60cde244559a823a47293540f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:35.359668 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-2bf46b08-3469-4129-bf53-a3104d4b3723 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] 10.222.0.32 "GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e" status: 200 len: 1547 microversion: 2.1 time: 0.321923 May 30 12:11:35.361414 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 446/880] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:11:35 2022] GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e => generated 1547 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:11:35.376602 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-4a92299d-8dc3-4c52-966e-2b9ac402d814 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:35.381914 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-4a92299d-8dc3-4c52-966e-2b9ac402d814 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c8915c74c4d24d2cb1cded5aa7927120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc19bd60cde244559a823a47293540f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:35.384252 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-4a92299d-8dc3-4c52-966e-2b9ac402d814 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Searching by: {'deleted': False, 'project_id': 'dc19bd60cde244559a823a47293540f7'} {{(pid=117670) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 30 12:11:35.395396 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4a92299d-8dc3-4c52-966e-2b9ac402d814 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:35.395855 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4a92299d-8dc3-4c52-966e-2b9ac402d814 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:35.397232 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4a92299d-8dc3-4c52-966e-2b9ac402d814 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:35.398646 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4a92299d-8dc3-4c52-966e-2b9ac402d814 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:35.514006 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.multi_cell_list [None req-4a92299d-8dc3-4c52-966e-2b9ac402d814 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117670) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 30 12:11:35.517245 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-aeae241e-9668-4ec8-986b-9f7bea3114f6 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:35.518341 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-aeae241e-9668-4ec8-986b-9f7bea3114f6 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] [instance: 0fff5784-b25c-4dad-9826-af23b4f7658a] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:35.534213 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-aeae241e-9668-4ec8-986b-9f7bea3114f6 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:35.535003 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-aeae241e-9668-4ec8-986b-9f7bea3114f6 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:35.536408 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-aeae241e-9668-4ec8-986b-9f7bea3114f6 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:35.537065 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-aeae241e-9668-4ec8-986b-9f7bea3114f6 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:35.670085 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-4a92299d-8dc3-4c52-966e-2b9ac402d814 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] 10.222.0.32 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.297208 May 30 12:11:35.672352 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 435/881] 10.222.0.32 () {58 vars in 1124 bytes} [Mon May 30 12:11:35 2022] GET /compute/v2.1/servers => generated 342 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:11:35.681752 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-23972865-52a3-4ece-9a97-d65406f0ae11 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:35.682711 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-23972865-52a3-4ece-9a97-d65406f0ae11 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] [instance: 4eb46ab6-5aba-438a-b5d0-b04d6ddee02e] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:35.691642 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-23972865-52a3-4ece-9a97-d65406f0ae11 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:35.693856 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-23972865-52a3-4ece-9a97-d65406f0ae11 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:35.695135 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-23972865-52a3-4ece-9a97-d65406f0ae11 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:35.696680 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-23972865-52a3-4ece-9a97-d65406f0ae11 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:35.883978 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-aeae241e-9668-4ec8-986b-9f7bea3114f6 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f869410b53b14949a0f066e0e4163a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9ea0feaee34c639f228a4f320f1aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:35.895978 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-aeae241e-9668-4ec8-986b-9f7bea3114f6 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] 10.222.0.32 "GET /compute/v2.1/servers/0fff5784-b25c-4dad-9826-af23b4f7658a" status: 200 len: 1315 microversion: 2.1 time: 0.383752 May 30 12:11:35.905247 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 447/882] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:11:35 2022] GET /compute/v2.1/servers/0fff5784-b25c-4dad-9826-af23b4f7658a => generated 1315 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:11:36.016949 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-23972865-52a3-4ece-9a97-d65406f0ae11 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8915c74c4d24d2cb1cded5aa7927120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc19bd60cde244559a823a47293540f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:36.027158 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-23972865-52a3-4ece-9a97-d65406f0ae11 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] 10.222.0.32 "GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e" status: 200 len: 1547 microversion: 2.1 time: 0.349865 May 30 12:11:36.027931 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 436/883] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:11:35 2022] GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e => generated 1547 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:11:36.914672 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-9755c3ab-f816-4ec0-afbd-c471090ddfec tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:36.915250 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-af90f9c4-def0-4d56-90c3-0d1b35b5e722 req-5e8f5b0d-3359-4f2c-b03e-cc303807fff7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fff5784-b25c-4dad-9826-af23b4f7658a", "name": "network-vif-plugged", "status": "completed", "tag": "88273239-7077-4f3d-b530-e64d6b1c2ba3"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:11:36.915634 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-9755c3ab-f816-4ec0-afbd-c471090ddfec tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] [instance: 0fff5784-b25c-4dad-9826-af23b4f7658a] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:36.929175 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9755c3ab-f816-4ec0-afbd-c471090ddfec tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:36.929626 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9755c3ab-f816-4ec0-afbd-c471090ddfec tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:36.930482 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9755c3ab-f816-4ec0-afbd-c471090ddfec tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:36.931053 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9755c3ab-f816-4ec0-afbd-c471090ddfec tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:36.932252 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-af90f9c4-def0-4d56-90c3-0d1b35b5e722 req-5e8f5b0d-3359-4f2c-b03e-cc303807fff7 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:36.932252 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-af90f9c4-def0-4d56-90c3-0d1b35b5e722 req-5e8f5b0d-3359-4f2c-b03e-cc303807fff7 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:36.963013 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-af90f9c4-def0-4d56-90c3-0d1b35b5e722 req-5e8f5b0d-3359-4f2c-b03e-cc303807fff7 service nova] Creating event network-vif-plugged:88273239-7077-4f3d-b530-e64d6b1c2ba3 for instance 0fff5784-b25c-4dad-9826-af23b4f7658a on hv-cinder-84051 May 30 12:11:36.978867 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-af90f9c4-def0-4d56-90c3-0d1b35b5e722 req-5e8f5b0d-3359-4f2c-b03e-cc303807fff7 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068726 May 30 12:11:36.991428 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 437/884] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:11:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 30 12:11:37.338342 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-9755c3ab-f816-4ec0-afbd-c471090ddfec tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f869410b53b14949a0f066e0e4163a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9ea0feaee34c639f228a4f320f1aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:37.351536 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-9755c3ab-f816-4ec0-afbd-c471090ddfec tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] 10.222.0.32 "GET /compute/v2.1/servers/0fff5784-b25c-4dad-9826-af23b4f7658a" status: 200 len: 1315 microversion: 2.1 time: 0.441668 May 30 12:11:37.352542 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 448/885] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:11:36 2022] GET /compute/v2.1/servers/0fff5784-b25c-4dad-9826-af23b4f7658a => generated 1315 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:11:37.735395 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-1f239f80-7b9b-444d-bd02-6e174845f7d4 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9c800c43-36ea-42e1-bab2-6f0840049f9c"}} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:11:37.737021 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-1f239f80-7b9b-444d-bd02-6e174845f7d4 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] [instance: 4eb46ab6-5aba-438a-b5d0-b04d6ddee02e] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:37.751245 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1f239f80-7b9b-444d-bd02-6e174845f7d4 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:37.752399 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1f239f80-7b9b-444d-bd02-6e174845f7d4 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:37.753455 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1f239f80-7b9b-444d-bd02-6e174845f7d4 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:37.758552 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1f239f80-7b9b-444d-bd02-6e174845f7d4 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:38.215595 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-1f239f80-7b9b-444d-bd02-6e174845f7d4 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] 10.222.0.32 "POST /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.485268 May 30 12:11:38.217431 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 438/886] 10.222.0.32 () {60 vars in 1322 bytes} [Mon May 30 12:11:37 2022] POST /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e/os-volume_attachments => generated 194 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 30 12:11:38.369732 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-1f17c0b8-127e-4071-9895-87ff7dc0a974 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:38.371053 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-1f17c0b8-127e-4071-9895-87ff7dc0a974 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] [instance: 0fff5784-b25c-4dad-9826-af23b4f7658a] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:38.377902 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1f17c0b8-127e-4071-9895-87ff7dc0a974 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:38.378374 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1f17c0b8-127e-4071-9895-87ff7dc0a974 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:38.379327 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1f17c0b8-127e-4071-9895-87ff7dc0a974 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:38.379593 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1f17c0b8-127e-4071-9895-87ff7dc0a974 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:38.813145 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-1f17c0b8-127e-4071-9895-87ff7dc0a974 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f869410b53b14949a0f066e0e4163a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9ea0feaee34c639f228a4f320f1aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:38.821699 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-1f17c0b8-127e-4071-9895-87ff7dc0a974 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] 10.222.0.32 "GET /compute/v2.1/servers/0fff5784-b25c-4dad-9826-af23b4f7658a" status: 200 len: 1465 microversion: 2.1 time: 0.456197 May 30 12:11:38.822273 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 449/887] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:11:38 2022] GET /compute/v2.1/servers/0fff5784-b25c-4dad-9826-af23b4f7658a => generated 1465 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:11:38.869164 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-e0fb99ae-5757-49d4-8c00-9d81a5576a1e tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:38.869956 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-e0fb99ae-5757-49d4-8c00-9d81a5576a1e tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] [instance: 0fff5784-b25c-4dad-9826-af23b4f7658a] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:38.878434 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e0fb99ae-5757-49d4-8c00-9d81a5576a1e tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:38.878986 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e0fb99ae-5757-49d4-8c00-9d81a5576a1e tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:38.881821 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e0fb99ae-5757-49d4-8c00-9d81a5576a1e tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:38.881821 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e0fb99ae-5757-49d4-8c00-9d81a5576a1e tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:38.912381 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-e0fb99ae-5757-49d4-8c00-9d81a5576a1e tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] [instance: 0fff5784-b25c-4dad-9826-af23b4f7658a] Going to try to terminate instance {{(pid=117670) delete /opt/stack/nova/nova/compute/api.py:2664}} May 30 12:11:39.001943 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-e0fb99ae-5757-49d4-8c00-9d81a5576a1e tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] 10.222.0.32 "DELETE /compute/v2.1/servers/0fff5784-b25c-4dad-9826-af23b4f7658a" status: 204 len: 0 microversion: 2.1 time: 0.136947 May 30 12:11:39.002719 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 439/888] 10.222.0.32 () {58 vars in 1238 bytes} [Mon May 30 12:11:38 2022] DELETE /compute/v2.1/servers/0fff5784-b25c-4dad-9826-af23b4f7658a => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 30 12:11:39.011834 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-cef90c8f-f26f-4c6c-a98e-6dea4c7951d1 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:39.012564 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-cef90c8f-f26f-4c6c-a98e-6dea4c7951d1 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] [instance: 0fff5784-b25c-4dad-9826-af23b4f7658a] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:39.015521 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:11:39.020207 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-cef90c8f-f26f-4c6c-a98e-6dea4c7951d1 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:39.021744 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-cef90c8f-f26f-4c6c-a98e-6dea4c7951d1 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:39.022597 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-cef90c8f-f26f-4c6c-a98e-6dea4c7951d1 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:39.023112 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-cef90c8f-f26f-4c6c-a98e-6dea4c7951d1 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:39.195889 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-cef90c8f-f26f-4c6c-a98e-6dea4c7951d1 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f869410b53b14949a0f066e0e4163a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9ea0feaee34c639f228a4f320f1aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:39.212719 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-cef90c8f-f26f-4c6c-a98e-6dea4c7951d1 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] 10.222.0.32 "GET /compute/v2.1/servers/0fff5784-b25c-4dad-9826-af23b4f7658a" status: 200 len: 1471 microversion: 2.1 time: 0.204636 May 30 12:11:39.213302 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 450/889] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:11:39 2022] GET /compute/v2.1/servers/0fff5784-b25c-4dad-9826-af23b4f7658a => generated 1471 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:11:40.231457 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-ef9326dd-fde6-4222-9dd2-0336e86ea634 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:40.232191 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-ef9326dd-fde6-4222-9dd2-0336e86ea634 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] [instance: 0fff5784-b25c-4dad-9826-af23b4f7658a] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:40.241030 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ef9326dd-fde6-4222-9dd2-0336e86ea634 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:40.242132 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ef9326dd-fde6-4222-9dd2-0336e86ea634 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:40.242924 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ef9326dd-fde6-4222-9dd2-0336e86ea634 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:40.243516 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ef9326dd-fde6-4222-9dd2-0336e86ea634 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:40.396814 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-ef9326dd-fde6-4222-9dd2-0336e86ea634 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f869410b53b14949a0f066e0e4163a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9ea0feaee34c639f228a4f320f1aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:40.404595 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-ef9326dd-fde6-4222-9dd2-0336e86ea634 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] 10.222.0.32 "GET /compute/v2.1/servers/0fff5784-b25c-4dad-9826-af23b4f7658a" status: 200 len: 1471 microversion: 2.1 time: 0.177904 May 30 12:11:40.405269 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 440/890] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:11:40 2022] GET /compute/v2.1/servers/0fff5784-b25c-4dad-9826-af23b4f7658a => generated 1471 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:11:41.422016 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-e336008f-4b0c-43b4-ba85-4a7cb0bbf14d tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:41.422634 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-e336008f-4b0c-43b4-ba85-4a7cb0bbf14d tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] [instance: 0fff5784-b25c-4dad-9826-af23b4f7658a] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:41.430032 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e336008f-4b0c-43b4-ba85-4a7cb0bbf14d tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:41.430487 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e336008f-4b0c-43b4-ba85-4a7cb0bbf14d tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:41.431282 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e336008f-4b0c-43b4-ba85-4a7cb0bbf14d tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:41.431767 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e336008f-4b0c-43b4-ba85-4a7cb0bbf14d tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:41.587987 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-e336008f-4b0c-43b4-ba85-4a7cb0bbf14d tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f869410b53b14949a0f066e0e4163a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9ea0feaee34c639f228a4f320f1aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:41.597384 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-e336008f-4b0c-43b4-ba85-4a7cb0bbf14d tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] 10.222.0.32 "GET /compute/v2.1/servers/0fff5784-b25c-4dad-9826-af23b4f7658a" status: 200 len: 1471 microversion: 2.1 time: 0.178603 May 30 12:11:41.598034 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 451/891] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:11:41 2022] GET /compute/v2.1/servers/0fff5784-b25c-4dad-9826-af23b4f7658a => generated 1471 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:11:42.615942 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-40fa7015-eea7-4fff-a27f-bca2ba1a0403 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:42.617185 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-40fa7015-eea7-4fff-a27f-bca2ba1a0403 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] [instance: 0fff5784-b25c-4dad-9826-af23b4f7658a] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:42.623807 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-40fa7015-eea7-4fff-a27f-bca2ba1a0403 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:42.624280 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-40fa7015-eea7-4fff-a27f-bca2ba1a0403 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:42.625049 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-40fa7015-eea7-4fff-a27f-bca2ba1a0403 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:42.625476 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-40fa7015-eea7-4fff-a27f-bca2ba1a0403 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:42.777093 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-40fa7015-eea7-4fff-a27f-bca2ba1a0403 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f869410b53b14949a0f066e0e4163a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9ea0feaee34c639f228a4f320f1aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:42.786914 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-40fa7015-eea7-4fff-a27f-bca2ba1a0403 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] 10.222.0.32 "GET /compute/v2.1/servers/0fff5784-b25c-4dad-9826-af23b4f7658a" status: 200 len: 1471 microversion: 2.1 time: 0.175899 May 30 12:11:42.788012 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 441/892] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:11:42 2022] GET /compute/v2.1/servers/0fff5784-b25c-4dad-9826-af23b4f7658a => generated 1471 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:11:43.243173 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-9c154c05-830b-47bc-ba6e-5aab398f406e req-f62510bc-658c-4c82-8a92-6f44738c58cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fff5784-b25c-4dad-9826-af23b4f7658a", "name": "network-vif-deleted", "tag": "88273239-7077-4f3d-b530-e64d6b1c2ba3"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:11:43.255552 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-9c154c05-830b-47bc-ba6e-5aab398f406e req-f62510bc-658c-4c82-8a92-6f44738c58cb service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:43.255995 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-9c154c05-830b-47bc-ba6e-5aab398f406e req-f62510bc-658c-4c82-8a92-6f44738c58cb service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:43.268539 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-9c154c05-830b-47bc-ba6e-5aab398f406e req-f62510bc-658c-4c82-8a92-6f44738c58cb service nova] Creating event network-vif-deleted:88273239-7077-4f3d-b530-e64d6b1c2ba3 for instance 0fff5784-b25c-4dad-9826-af23b4f7658a on hv-cinder-84051 May 30 12:11:43.273751 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-9c154c05-830b-47bc-ba6e-5aab398f406e req-f62510bc-658c-4c82-8a92-6f44738c58cb service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034353 May 30 12:11:43.274345 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 452/893] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:11:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:11:43.804349 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-d049daca-d6aa-4968-92c2-64c226343d27 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:43.804903 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-d049daca-d6aa-4968-92c2-64c226343d27 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] [instance: 0fff5784-b25c-4dad-9826-af23b4f7658a] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:43.807399 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:11:43.812771 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d049daca-d6aa-4968-92c2-64c226343d27 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:43.813221 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d049daca-d6aa-4968-92c2-64c226343d27 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:43.814050 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d049daca-d6aa-4968-92c2-64c226343d27 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:43.814428 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d049daca-d6aa-4968-92c2-64c226343d27 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:43.879937 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-d049daca-d6aa-4968-92c2-64c226343d27 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f869410b53b14949a0f066e0e4163a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9ea0feaee34c639f228a4f320f1aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:43.887687 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-d049daca-d6aa-4968-92c2-64c226343d27 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] 10.222.0.32 "GET /compute/v2.1/servers/0fff5784-b25c-4dad-9826-af23b4f7658a" status: 200 len: 1300 microversion: 2.1 time: 0.087337 May 30 12:11:43.888285 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 442/894] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:11:43 2022] GET /compute/v2.1/servers/0fff5784-b25c-4dad-9826-af23b4f7658a => generated 1300 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:11:44.906641 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-5054e01f-4f57-43a9-ba74-3b350903aafd tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:44.907322 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-5054e01f-4f57-43a9-ba74-3b350903aafd tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] [instance: 0fff5784-b25c-4dad-9826-af23b4f7658a] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:44.914686 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5054e01f-4f57-43a9-ba74-3b350903aafd tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:44.915123 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5054e01f-4f57-43a9-ba74-3b350903aafd tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:44.915886 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5054e01f-4f57-43a9-ba74-3b350903aafd tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:44.916341 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5054e01f-4f57-43a9-ba74-3b350903aafd tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:44.980212 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-5054e01f-4f57-43a9-ba74-3b350903aafd tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f869410b53b14949a0f066e0e4163a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9ea0feaee34c639f228a4f320f1aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:44.988526 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-5054e01f-4f57-43a9-ba74-3b350903aafd tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] 10.222.0.32 "GET /compute/v2.1/servers/0fff5784-b25c-4dad-9826-af23b4f7658a" status: 200 len: 1300 microversion: 2.1 time: 0.086668 May 30 12:11:44.989111 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 453/895] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:11:44 2022] GET /compute/v2.1/servers/0fff5784-b25c-4dad-9826-af23b4f7658a => generated 1300 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:11:46.006631 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-ee8972cf-b0c7-405e-bb51-464176e1b868 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:46.007272 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-ee8972cf-b0c7-405e-bb51-464176e1b868 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] [instance: 0fff5784-b25c-4dad-9826-af23b4f7658a] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:46.009601 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell0:SELECT=2 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:11:46.015037 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ee8972cf-b0c7-405e-bb51-464176e1b868 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:46.015490 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ee8972cf-b0c7-405e-bb51-464176e1b868 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:46.016306 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ee8972cf-b0c7-405e-bb51-464176e1b868 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:46.016767 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ee8972cf-b0c7-405e-bb51-464176e1b868 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:46.032314 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.wsgi [None req-ee8972cf-b0c7-405e-bb51-464176e1b868 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] HTTP exception thrown: Instance 0fff5784-b25c-4dad-9826-af23b4f7658a could not be found. May 30 12:11:46.034617 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-ee8972cf-b0c7-405e-bb51-464176e1b868 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Request method failure captured: May 30 12:11:46.034617 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: request: GET /compute/v2.1/servers/0fff5784-b25c-4dad-9826-af23b4f7658a HTTP/1.1 May 30 12:11:46.034617 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Accept: application/json May 30 12:11:46.034617 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Accept-Encoding: identity May 30 12:11:46.034617 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Connection: close May 30 12:11:46.034617 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Content-Length: 0 May 30 12:11:46.034617 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Content-Type: application/json May 30 12:11:46.034617 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Host: 10.222.0.32 May 30 12:11:46.034617 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Openstack-System-Scope: None May 30 12:11:46.034617 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: User-Agent: python-urllib3/1.26.9 May 30 12:11:46.034617 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Auth-Token: gAAAAABilLRnFlC8whno-0rpGCTwOWD4FCQsb9FXiF4FxKs5nEgDKGCgvd-_0pCUfZdieTK28Wo_rwoFDpx1F6K-2lWH15kZM5PmhIThIkVgjxZ4gIc-MaeOMza_iZ_CqV0FKtuIx1dhU9HW2QIGXUbH2kGVxUyrAATuvSnJXLIS6HkYMifJ3gA May 30 12:11:46.034617 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Domain-Id: None May 30 12:11:46.034617 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Domain-Name: None May 30 12:11:46.034617 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Identity-Status: Confirmed May 30 12:11:46.034617 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Is-Admin-Project: True May 30 12:11:46.034617 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Domain-Id: default May 30 12:11:46.034617 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Domain-Name: Default May 30 12:11:46.034617 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Id: 0b9ea0feaee34c639f228a4f320f1aa3 May 30 12:11:46.034617 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Name: tempest-VolumesNegativeTest-611283538 May 30 12:11:46.034617 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Role: reader,member May 30 12:11:46.034617 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Roles: reader,member May 30 12:11:46.036858 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/0b9ea0feaee34c639f228a4f320f1aa3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/0b9ea0feaee34c639f228a4f320f1aa3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/0b9ea0feaee34c639f228a4f320f1aa3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_0b9ea0feaee34c639f228a4f320f1aa3", "adminURL": "http://10.222.0.32:8080"}]}] May 30 12:11:46.036858 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant: tempest-VolumesNegativeTest-611283538 May 30 12:11:46.036858 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant-Id: 0b9ea0feaee34c639f228a4f320f1aa3 May 30 12:11:46.036858 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant-Name: tempest-VolumesNegativeTest-611283538 May 30 12:11:46.036858 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User: tempest-VolumesNegativeTest-611283538-project May 30 12:11:46.036858 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Domain-Id: default May 30 12:11:46.036858 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Domain-Name: Default May 30 12:11:46.036858 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Id: f869410b53b14949a0f066e0e4163a45 May 30 12:11:46.036858 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Name: tempest-VolumesNegativeTest-611283538-project May 30 12:11:46.036858 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: method: > May 30 12:11:46.036858 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: exception: Instance 0fff5784-b25c-4dad-9826-af23b4f7658a could not be found. May 30 12:11:46.036858 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: action_args: {'id': '0fff5784-b25c-4dad-9826-af23b4f7658a'} May 30 12:11:46.037798 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:11:46.037798 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:11:46.037798 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:11:46.037798 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:11:46.037798 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:11:46.037798 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:11:46.037798 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:11:46.037798 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:11:46.037798 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:11:46.037798 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:11:46.037798 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fff5784-b25c-4dad-9826-af23b4f7658a could not be found. May 30 12:11:46.037798 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:11:46.037798 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:11:46.037798 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:11:46.037798 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:11:46.037798 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:11:46.037798 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:11:46.037798 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:11:46.037798 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:11:46.037798 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:11:46.039210 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:11:46.039210 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 30 12:11:46.039210 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 30 12:11:46.039210 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 30 12:11:46.039210 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 30 12:11:46.039210 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:11:46.039210 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:11:46.039210 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fff5784-b25c-4dad-9826-af23b4f7658a could not be found. May 30 12:11:46.039210 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:11:46.039210 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:11:46.039210 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:11:46.039210 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:11:46.039210 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:11:46.039210 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:11:46.039210 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:11:46.039210 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:11:46.039210 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fff5784-b25c-4dad-9826-af23b4f7658a could not be found. May 30 12:11:46.039210 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:11:46.040467 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-ee8972cf-b0c7-405e-bb51-464176e1b868 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] Returning 404 to user: Instance 0fff5784-b25c-4dad-9826-af23b4f7658a could not be found. {{(pid=117670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:11:46.040467 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-ee8972cf-b0c7-405e-bb51-464176e1b868 tempest-VolumesNegativeTest-611283538 tempest-VolumesNegativeTest-611283538-project] 10.222.0.32 "GET /compute/v2.1/servers/0fff5784-b25c-4dad-9826-af23b4f7658a" status: 404 len: 111 microversion: 2.1 time: 0.034020 May 30 12:11:46.040467 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 443/896] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:11:46 2022] GET /compute/v2.1/servers/0fff5784-b25c-4dad-9826-af23b4f7658a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 30 12:11:49.147906 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-5bb41368-55d6-4777-8fff-548489d198b7 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:49.148475 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-5bb41368-55d6-4777-8fff-548489d198b7 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] [instance: 4eb46ab6-5aba-438a-b5d0-b04d6ddee02e] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:49.156908 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5bb41368-55d6-4777-8fff-548489d198b7 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:49.157390 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5bb41368-55d6-4777-8fff-548489d198b7 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:49.158167 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5bb41368-55d6-4777-8fff-548489d198b7 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:49.158600 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5bb41368-55d6-4777-8fff-548489d198b7 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:49.301312 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-5bb41368-55d6-4777-8fff-548489d198b7 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8915c74c4d24d2cb1cded5aa7927120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc19bd60cde244559a823a47293540f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:49.309315 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-5bb41368-55d6-4777-8fff-548489d198b7 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] 10.222.0.32 "GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e" status: 200 len: 1593 microversion: 2.1 time: 0.165362 May 30 12:11:49.309870 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 454/897] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:11:49 2022] GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e => generated 1593 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:11:51.460506 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-e8c41b42-feae-4594-866b-ec4075b9928b req-07535333-842c-4afa-873d-43c972bc5fea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4eb46ab6-5aba-438a-b5d0-b04d6ddee02e", "tag": "a3736af0-e6ce-4bc1-adc2-3c3c8417fdb9"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:11:51.470182 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-e8c41b42-feae-4594-866b-ec4075b9928b req-07535333-842c-4afa-873d-43c972bc5fea service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:51.470998 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-e8c41b42-feae-4594-866b-ec4075b9928b req-07535333-842c-4afa-873d-43c972bc5fea service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:51.483035 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:11:51.485517 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-e8c41b42-feae-4594-866b-ec4075b9928b req-07535333-842c-4afa-873d-43c972bc5fea service nova] Creating event network-changed:a3736af0-e6ce-4bc1-adc2-3c3c8417fdb9 for instance 4eb46ab6-5aba-438a-b5d0-b04d6ddee02e on hv-cinder-84051 May 30 12:11:51.493227 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-e8c41b42-feae-4594-866b-ec4075b9928b req-07535333-842c-4afa-873d-43c972bc5fea service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038167 May 30 12:11:51.494461 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 444/898] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:11:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:11:53.004551 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-8ca3ca1d-a409-4162-9c17-9f23837c01ea tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-55921125"}} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:11:53.006214 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-8ca3ca1d-a409-4162-9c17-9f23837c01ea tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] [instance: 4eb46ab6-5aba-438a-b5d0-b04d6ddee02e] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:53.015838 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8ca3ca1d-a409-4162-9c17-9f23837c01ea tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:53.016757 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8ca3ca1d-a409-4162-9c17-9f23837c01ea tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:53.018242 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8ca3ca1d-a409-4162-9c17-9f23837c01ea tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:53.018914 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8ca3ca1d-a409-4162-9c17-9f23837c01ea tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:53.242706 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.network.security_group_api [None req-8ca3ca1d-a409-4162-9c17-9f23837c01ea tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Adding security group db775c86-ece9-48e3-99d3-7a447f58571b to port a3736af0-e6ce-4bc1-adc2-3c3c8417fdb9 May 30 12:11:53.774599 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-8ca3ca1d-a409-4162-9c17-9f23837c01ea tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] 10.222.0.32 "POST /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e/action" status: 202 len: 0 microversion: 2.1 time: 0.780742 May 30 12:11:53.775693 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 455/899] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 30 12:11:52 2022] POST /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e/action => generated 0 bytes in 784 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 30 12:11:53.788593 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-106cdc67-db36-4699-b96d-ec8489d20461 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:53.789693 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-106cdc67-db36-4699-b96d-ec8489d20461 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] [instance: 4eb46ab6-5aba-438a-b5d0-b04d6ddee02e] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:53.798947 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-106cdc67-db36-4699-b96d-ec8489d20461 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:53.799447 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-106cdc67-db36-4699-b96d-ec8489d20461 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:53.804109 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-106cdc67-db36-4699-b96d-ec8489d20461 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:53.807993 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-106cdc67-db36-4699-b96d-ec8489d20461 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:53.816572 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-46dba9a3-deea-4d25-8bec-7949ef064429 req-0c75c53b-99b2-4f88-94af-757f9cd1d794 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4eb46ab6-5aba-438a-b5d0-b04d6ddee02e", "tag": "a3736af0-e6ce-4bc1-adc2-3c3c8417fdb9"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:11:53.828295 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-46dba9a3-deea-4d25-8bec-7949ef064429 req-0c75c53b-99b2-4f88-94af-757f9cd1d794 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:53.828894 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-46dba9a3-deea-4d25-8bec-7949ef064429 req-0c75c53b-99b2-4f88-94af-757f9cd1d794 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:53.866400 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-46dba9a3-deea-4d25-8bec-7949ef064429 req-0c75c53b-99b2-4f88-94af-757f9cd1d794 service nova] Creating event network-changed:a3736af0-e6ce-4bc1-adc2-3c3c8417fdb9 for instance 4eb46ab6-5aba-438a-b5d0-b04d6ddee02e on hv-cinder-84051 May 30 12:11:53.874057 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-46dba9a3-deea-4d25-8bec-7949ef064429 req-0c75c53b-99b2-4f88-94af-757f9cd1d794 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070585 May 30 12:11:53.875696 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 456/900] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:11:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:11:54.020592 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-106cdc67-db36-4699-b96d-ec8489d20461 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8915c74c4d24d2cb1cded5aa7927120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc19bd60cde244559a823a47293540f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:54.031578 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-106cdc67-db36-4699-b96d-ec8489d20461 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] 10.222.0.32 "GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e" status: 200 len: 1757 microversion: 2.1 time: 0.251669 May 30 12:11:54.036963 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 445/901] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:11:53 2022] GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e => generated 1757 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:12:16.708025 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_api:SELECT=12 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:12:16.708798 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell1:SELECT=84 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:12:16.713446 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-e1cec26b-21d5-46c7-8893-bb23fb7dda66 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:12:16.714473 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-e1cec26b-21d5-46c7-8893-bb23fb7dda66 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] [instance: 4eb46ab6-5aba-438a-b5d0-b04d6ddee02e] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:16.721419 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e1cec26b-21d5-46c7-8893-bb23fb7dda66 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:16.721863 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e1cec26b-21d5-46c7-8893-bb23fb7dda66 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:16.722625 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e1cec26b-21d5-46c7-8893-bb23fb7dda66 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:16.723059 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e1cec26b-21d5-46c7-8893-bb23fb7dda66 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:16.797729 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-e1cec26b-21d5-46c7-8893-bb23fb7dda66 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] 10.222.0.32 "POST /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e/action" status: 202 len: 0 microversion: 2.1 time: 0.091013 May 30 12:12:16.798511 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 457/902] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 30 12:12:16 2022] POST /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 30 12:12:16.807672 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-8a173143-8017-4051-97bb-8ac44111c92d tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:16.808453 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-8a173143-8017-4051-97bb-8ac44111c92d tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] [instance: 4eb46ab6-5aba-438a-b5d0-b04d6ddee02e] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:16.810859 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_api:SELECT=7 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:12:16.811659 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell1:SELECT=6 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:12:16.818652 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8a173143-8017-4051-97bb-8ac44111c92d tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:16.819109 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8a173143-8017-4051-97bb-8ac44111c92d tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:16.819922 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8a173143-8017-4051-97bb-8ac44111c92d tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:16.820396 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8a173143-8017-4051-97bb-8ac44111c92d tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:16.975374 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-8a173143-8017-4051-97bb-8ac44111c92d tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8915c74c4d24d2cb1cded5aa7927120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc19bd60cde244559a823a47293540f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:16.983610 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-8a173143-8017-4051-97bb-8ac44111c92d tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] 10.222.0.32 "GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e" status: 200 len: 1749 microversion: 2.1 time: 0.180149 May 30 12:12:16.984310 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 446/903] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:12:16 2022] GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e => generated 1749 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:12:18.002686 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-20710464-1000-43b5-9121-199de5af7ef8 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:18.003302 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-20710464-1000-43b5-9121-199de5af7ef8 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] [instance: 4eb46ab6-5aba-438a-b5d0-b04d6ddee02e] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:18.009971 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-20710464-1000-43b5-9121-199de5af7ef8 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:18.010418 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-20710464-1000-43b5-9121-199de5af7ef8 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:18.011187 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-20710464-1000-43b5-9121-199de5af7ef8 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:18.011618 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-20710464-1000-43b5-9121-199de5af7ef8 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:18.155276 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-20710464-1000-43b5-9121-199de5af7ef8 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8915c74c4d24d2cb1cded5aa7927120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc19bd60cde244559a823a47293540f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:18.163820 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-20710464-1000-43b5-9121-199de5af7ef8 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] 10.222.0.32 "GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e" status: 200 len: 1754 microversion: 2.1 time: 0.166029 May 30 12:12:18.164421 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 458/904] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:12:17 2022] GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e => generated 1754 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:12:19.181983 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-5767e067-3a9a-496f-a963-ff5b08d005bc tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:19.182591 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-5767e067-3a9a-496f-a963-ff5b08d005bc tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] [instance: 4eb46ab6-5aba-438a-b5d0-b04d6ddee02e] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:19.189014 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5767e067-3a9a-496f-a963-ff5b08d005bc tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:19.189449 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5767e067-3a9a-496f-a963-ff5b08d005bc tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:19.190288 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5767e067-3a9a-496f-a963-ff5b08d005bc tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:19.190718 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5767e067-3a9a-496f-a963-ff5b08d005bc tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:19.350510 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-5767e067-3a9a-496f-a963-ff5b08d005bc tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8915c74c4d24d2cb1cded5aa7927120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc19bd60cde244559a823a47293540f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:19.358660 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-5767e067-3a9a-496f-a963-ff5b08d005bc tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] 10.222.0.32 "GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e" status: 200 len: 1754 microversion: 2.1 time: 0.180885 May 30 12:12:19.359288 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 447/905] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:12:19 2022] GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e => generated 1754 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:12:20.377360 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-f418d5ce-ed60-4455-b52b-7ed3e74d16d6 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:20.380124 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-f418d5ce-ed60-4455-b52b-7ed3e74d16d6 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] [instance: 4eb46ab6-5aba-438a-b5d0-b04d6ddee02e] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:20.387201 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f418d5ce-ed60-4455-b52b-7ed3e74d16d6 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:20.387832 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f418d5ce-ed60-4455-b52b-7ed3e74d16d6 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:20.388654 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f418d5ce-ed60-4455-b52b-7ed3e74d16d6 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:20.389094 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f418d5ce-ed60-4455-b52b-7ed3e74d16d6 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:20.544570 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-f418d5ce-ed60-4455-b52b-7ed3e74d16d6 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8915c74c4d24d2cb1cded5aa7927120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc19bd60cde244559a823a47293540f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:20.556190 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-f418d5ce-ed60-4455-b52b-7ed3e74d16d6 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] 10.222.0.32 "GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e" status: 200 len: 1754 microversion: 2.1 time: 0.182773 May 30 12:12:20.556782 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 459/906] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:12:20 2022] GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e => generated 1754 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:12:21.575022 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-dcb83869-ca3b-4654-bb8b-4ab9b584080d tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:21.575637 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-dcb83869-ca3b-4654-bb8b-4ab9b584080d tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] [instance: 4eb46ab6-5aba-438a-b5d0-b04d6ddee02e] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:21.582207 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-dcb83869-ca3b-4654-bb8b-4ab9b584080d tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:21.582620 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-dcb83869-ca3b-4654-bb8b-4ab9b584080d tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:21.583796 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-dcb83869-ca3b-4654-bb8b-4ab9b584080d tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:21.584260 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-dcb83869-ca3b-4654-bb8b-4ab9b584080d tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:21.743028 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-dcb83869-ca3b-4654-bb8b-4ab9b584080d tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8915c74c4d24d2cb1cded5aa7927120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc19bd60cde244559a823a47293540f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:21.749253 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-dcb83869-ca3b-4654-bb8b-4ab9b584080d tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] 10.222.0.32 "GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e" status: 200 len: 1754 microversion: 2.1 time: 0.178097 May 30 12:12:21.749641 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 448/907] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:12:21 2022] GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e => generated 1754 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:12:22.766223 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-8a0456cf-74b7-4b78-a716-ea544e9de664 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:22.766839 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-8a0456cf-74b7-4b78-a716-ea544e9de664 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] [instance: 4eb46ab6-5aba-438a-b5d0-b04d6ddee02e] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:22.774451 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8a0456cf-74b7-4b78-a716-ea544e9de664 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:22.774904 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8a0456cf-74b7-4b78-a716-ea544e9de664 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:22.775677 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8a0456cf-74b7-4b78-a716-ea544e9de664 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:22.776119 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8a0456cf-74b7-4b78-a716-ea544e9de664 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:22.922364 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-8a0456cf-74b7-4b78-a716-ea544e9de664 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8915c74c4d24d2cb1cded5aa7927120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc19bd60cde244559a823a47293540f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:22.931580 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-8a0456cf-74b7-4b78-a716-ea544e9de664 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] 10.222.0.32 "GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e" status: 200 len: 1754 microversion: 2.1 time: 0.169170 May 30 12:12:22.932451 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 460/908] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:12:22 2022] GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e => generated 1754 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:12:23.950292 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-a288043f-45fb-438c-890c-c0dd211b2142 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:23.950811 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-a288043f-45fb-438c-890c-c0dd211b2142 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] [instance: 4eb46ab6-5aba-438a-b5d0-b04d6ddee02e] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:23.957359 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a288043f-45fb-438c-890c-c0dd211b2142 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:23.957814 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a288043f-45fb-438c-890c-c0dd211b2142 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:23.958580 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a288043f-45fb-438c-890c-c0dd211b2142 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:23.959019 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a288043f-45fb-438c-890c-c0dd211b2142 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:24.103467 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-a288043f-45fb-438c-890c-c0dd211b2142 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8915c74c4d24d2cb1cded5aa7927120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc19bd60cde244559a823a47293540f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:24.111518 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-a288043f-45fb-438c-890c-c0dd211b2142 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] 10.222.0.32 "GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e" status: 200 len: 1754 microversion: 2.1 time: 0.165239 May 30 12:12:24.112086 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 449/909] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:12:23 2022] GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:12:25.129787 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-4e388b1c-aeda-4a1d-9209-a89c0b7d0ff6 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:25.130389 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-4e388b1c-aeda-4a1d-9209-a89c0b7d0ff6 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] [instance: 4eb46ab6-5aba-438a-b5d0-b04d6ddee02e] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:25.137106 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4e388b1c-aeda-4a1d-9209-a89c0b7d0ff6 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:25.137545 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4e388b1c-aeda-4a1d-9209-a89c0b7d0ff6 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:25.138297 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4e388b1c-aeda-4a1d-9209-a89c0b7d0ff6 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:25.138725 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4e388b1c-aeda-4a1d-9209-a89c0b7d0ff6 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:25.290616 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-4e388b1c-aeda-4a1d-9209-a89c0b7d0ff6 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8915c74c4d24d2cb1cded5aa7927120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc19bd60cde244559a823a47293540f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:25.299339 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-4e388b1c-aeda-4a1d-9209-a89c0b7d0ff6 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] 10.222.0.32 "GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e" status: 200 len: 1754 microversion: 2.1 time: 0.173287 May 30 12:12:25.299955 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 461/910] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:12:25 2022] GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e => generated 1754 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:12:26.319640 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-e039bdc7-189d-49e8-91b8-1904f2050c25 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:26.320694 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-e039bdc7-189d-49e8-91b8-1904f2050c25 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] [instance: 4eb46ab6-5aba-438a-b5d0-b04d6ddee02e] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:26.327278 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e039bdc7-189d-49e8-91b8-1904f2050c25 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:26.327731 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e039bdc7-189d-49e8-91b8-1904f2050c25 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:26.328539 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e039bdc7-189d-49e8-91b8-1904f2050c25 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:26.329239 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e039bdc7-189d-49e8-91b8-1904f2050c25 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:26.474502 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-e039bdc7-189d-49e8-91b8-1904f2050c25 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8915c74c4d24d2cb1cded5aa7927120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc19bd60cde244559a823a47293540f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:26.483358 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-e039bdc7-189d-49e8-91b8-1904f2050c25 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] 10.222.0.32 "GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e" status: 200 len: 1754 microversion: 2.1 time: 0.167969 May 30 12:12:26.483934 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 450/911] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:12:26 2022] GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e => generated 1754 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:12:27.500407 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-ca7b06c5-0177-46d5-8fd1-7d08455e109f tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:27.501022 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-ca7b06c5-0177-46d5-8fd1-7d08455e109f tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] [instance: 4eb46ab6-5aba-438a-b5d0-b04d6ddee02e] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:27.508040 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ca7b06c5-0177-46d5-8fd1-7d08455e109f tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:27.508530 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ca7b06c5-0177-46d5-8fd1-7d08455e109f tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:27.509334 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ca7b06c5-0177-46d5-8fd1-7d08455e109f tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:27.509773 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ca7b06c5-0177-46d5-8fd1-7d08455e109f tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:27.668391 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-ca7b06c5-0177-46d5-8fd1-7d08455e109f tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8915c74c4d24d2cb1cded5aa7927120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc19bd60cde244559a823a47293540f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:27.676278 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-ca7b06c5-0177-46d5-8fd1-7d08455e109f tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] 10.222.0.32 "GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e" status: 200 len: 1754 microversion: 2.1 time: 0.179784 May 30 12:12:27.676853 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 462/912] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:12:27 2022] GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e => generated 1754 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:12:28.694564 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-2b82f9c0-3aa8-4228-a5c4-073770041e0e tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:28.695172 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-2b82f9c0-3aa8-4228-a5c4-073770041e0e tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] [instance: 4eb46ab6-5aba-438a-b5d0-b04d6ddee02e] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:28.701427 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2b82f9c0-3aa8-4228-a5c4-073770041e0e tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:28.701892 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2b82f9c0-3aa8-4228-a5c4-073770041e0e tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:28.702658 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2b82f9c0-3aa8-4228-a5c4-073770041e0e tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:28.703096 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2b82f9c0-3aa8-4228-a5c4-073770041e0e tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:28.852097 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-2b82f9c0-3aa8-4228-a5c4-073770041e0e tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8915c74c4d24d2cb1cded5aa7927120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc19bd60cde244559a823a47293540f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:28.860305 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-2b82f9c0-3aa8-4228-a5c4-073770041e0e tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] 10.222.0.32 "GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e" status: 200 len: 1754 microversion: 2.1 time: 0.170084 May 30 12:12:28.860880 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 451/913] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:12:28 2022] GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e => generated 1754 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:12:29.877613 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-a5007e7a-4271-4187-8c3f-29a917a39749 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:29.878205 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-a5007e7a-4271-4187-8c3f-29a917a39749 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] [instance: 4eb46ab6-5aba-438a-b5d0-b04d6ddee02e] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:29.886217 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a5007e7a-4271-4187-8c3f-29a917a39749 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:29.886669 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a5007e7a-4271-4187-8c3f-29a917a39749 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:29.887446 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a5007e7a-4271-4187-8c3f-29a917a39749 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:29.887879 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a5007e7a-4271-4187-8c3f-29a917a39749 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:30.047315 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-a5007e7a-4271-4187-8c3f-29a917a39749 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8915c74c4d24d2cb1cded5aa7927120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc19bd60cde244559a823a47293540f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:30.056638 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-a5007e7a-4271-4187-8c3f-29a917a39749 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] 10.222.0.32 "GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e" status: 200 len: 1754 microversion: 2.1 time: 0.182845 May 30 12:12:30.057220 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 463/914] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:12:29 2022] GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e => generated 1754 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:12:31.074111 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-6eef61f7-6fc7-4f26-b4a9-b30a7bc6a6bb tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:31.074937 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-6eef61f7-6fc7-4f26-b4a9-b30a7bc6a6bb tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] [instance: 4eb46ab6-5aba-438a-b5d0-b04d6ddee02e] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:31.081654 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6eef61f7-6fc7-4f26-b4a9-b30a7bc6a6bb tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:31.082118 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6eef61f7-6fc7-4f26-b4a9-b30a7bc6a6bb tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:31.082885 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6eef61f7-6fc7-4f26-b4a9-b30a7bc6a6bb tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:31.083318 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6eef61f7-6fc7-4f26-b4a9-b30a7bc6a6bb tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:31.279173 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-6eef61f7-6fc7-4f26-b4a9-b30a7bc6a6bb tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8915c74c4d24d2cb1cded5aa7927120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc19bd60cde244559a823a47293540f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:31.288062 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-6eef61f7-6fc7-4f26-b4a9-b30a7bc6a6bb tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] 10.222.0.32 "GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e" status: 200 len: 1754 microversion: 2.1 time: 0.217294 May 30 12:12:31.288874 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 452/915] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:12:31 2022] GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e => generated 1754 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:12:32.305911 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-5998ea4c-2ace-4388-bee3-dcc9ac23be32 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:32.306541 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-5998ea4c-2ace-4388-bee3-dcc9ac23be32 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] [instance: 4eb46ab6-5aba-438a-b5d0-b04d6ddee02e] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:32.313191 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5998ea4c-2ace-4388-bee3-dcc9ac23be32 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:32.313636 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5998ea4c-2ace-4388-bee3-dcc9ac23be32 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:32.314397 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5998ea4c-2ace-4388-bee3-dcc9ac23be32 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:32.314827 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5998ea4c-2ace-4388-bee3-dcc9ac23be32 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:32.457229 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-5998ea4c-2ace-4388-bee3-dcc9ac23be32 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8915c74c4d24d2cb1cded5aa7927120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc19bd60cde244559a823a47293540f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:32.465822 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-5998ea4c-2ace-4388-bee3-dcc9ac23be32 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] 10.222.0.32 "GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e" status: 200 len: 1754 microversion: 2.1 time: 0.164360 May 30 12:12:32.466383 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 464/916] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:12:32 2022] GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:12:33.483376 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-74cc07b5-b294-4fc4-b28d-1775a45869bf tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:33.483935 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-74cc07b5-b294-4fc4-b28d-1775a45869bf tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] [instance: 4eb46ab6-5aba-438a-b5d0-b04d6ddee02e] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:33.490505 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-74cc07b5-b294-4fc4-b28d-1775a45869bf tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:33.490956 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-74cc07b5-b294-4fc4-b28d-1775a45869bf tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:33.491723 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-74cc07b5-b294-4fc4-b28d-1775a45869bf tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:33.492171 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-74cc07b5-b294-4fc4-b28d-1775a45869bf tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:33.635040 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-74cc07b5-b294-4fc4-b28d-1775a45869bf tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8915c74c4d24d2cb1cded5aa7927120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc19bd60cde244559a823a47293540f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:33.643245 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-74cc07b5-b294-4fc4-b28d-1775a45869bf tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] 10.222.0.32 "GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e" status: 200 len: 1754 microversion: 2.1 time: 0.163841 May 30 12:12:33.643813 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 453/917] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:12:33 2022] GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:12:34.660853 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-d7608f64-a28e-4be9-b617-94a8fbc57e17 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:34.661464 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-d7608f64-a28e-4be9-b617-94a8fbc57e17 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] [instance: 4eb46ab6-5aba-438a-b5d0-b04d6ddee02e] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:34.668949 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d7608f64-a28e-4be9-b617-94a8fbc57e17 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:34.669390 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d7608f64-a28e-4be9-b617-94a8fbc57e17 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:34.670175 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d7608f64-a28e-4be9-b617-94a8fbc57e17 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:34.670611 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d7608f64-a28e-4be9-b617-94a8fbc57e17 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:34.820496 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-d7608f64-a28e-4be9-b617-94a8fbc57e17 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8915c74c4d24d2cb1cded5aa7927120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc19bd60cde244559a823a47293540f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:34.828583 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-d7608f64-a28e-4be9-b617-94a8fbc57e17 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] 10.222.0.32 "GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e" status: 200 len: 1754 microversion: 2.1 time: 0.171546 May 30 12:12:34.829437 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 465/918] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:12:34 2022] GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e => generated 1754 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:12:35.846885 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-ae59c16a-ffe1-4591-9c5d-ffba3257a82f tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:35.847477 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-ae59c16a-ffe1-4591-9c5d-ffba3257a82f tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] [instance: 4eb46ab6-5aba-438a-b5d0-b04d6ddee02e] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:35.854674 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ae59c16a-ffe1-4591-9c5d-ffba3257a82f tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:35.855100 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ae59c16a-ffe1-4591-9c5d-ffba3257a82f tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:35.855869 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ae59c16a-ffe1-4591-9c5d-ffba3257a82f tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:35.856339 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ae59c16a-ffe1-4591-9c5d-ffba3257a82f tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:36.007203 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-ae59c16a-ffe1-4591-9c5d-ffba3257a82f tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8915c74c4d24d2cb1cded5aa7927120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc19bd60cde244559a823a47293540f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:36.015342 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-ae59c16a-ffe1-4591-9c5d-ffba3257a82f tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] 10.222.0.32 "GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e" status: 200 len: 1754 microversion: 2.1 time: 0.172221 May 30 12:12:36.015921 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 454/919] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:12:35 2022] GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e => generated 1754 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:12:37.033168 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-246577da-f72f-4d1c-b64e-c5244dfa3f66 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:37.033768 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-246577da-f72f-4d1c-b64e-c5244dfa3f66 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] [instance: 4eb46ab6-5aba-438a-b5d0-b04d6ddee02e] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:37.040483 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-246577da-f72f-4d1c-b64e-c5244dfa3f66 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:37.040927 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-246577da-f72f-4d1c-b64e-c5244dfa3f66 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:37.041690 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-246577da-f72f-4d1c-b64e-c5244dfa3f66 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:37.042122 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-246577da-f72f-4d1c-b64e-c5244dfa3f66 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:37.187636 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-246577da-f72f-4d1c-b64e-c5244dfa3f66 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8915c74c4d24d2cb1cded5aa7927120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc19bd60cde244559a823a47293540f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:37.195755 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-246577da-f72f-4d1c-b64e-c5244dfa3f66 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] 10.222.0.32 "GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e" status: 200 len: 1754 microversion: 2.1 time: 0.166477 May 30 12:12:37.196331 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 466/920] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:12:37 2022] GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e => generated 1754 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:12:38.213758 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-beffcf76-f642-4d05-a8fb-3f1c0c240b0f tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:38.215032 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-beffcf76-f642-4d05-a8fb-3f1c0c240b0f tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] [instance: 4eb46ab6-5aba-438a-b5d0-b04d6ddee02e] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:38.221638 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-beffcf76-f642-4d05-a8fb-3f1c0c240b0f tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:38.222082 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-beffcf76-f642-4d05-a8fb-3f1c0c240b0f tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:38.222839 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-beffcf76-f642-4d05-a8fb-3f1c0c240b0f tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:38.223271 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-beffcf76-f642-4d05-a8fb-3f1c0c240b0f tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:38.367296 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-beffcf76-f642-4d05-a8fb-3f1c0c240b0f tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8915c74c4d24d2cb1cded5aa7927120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc19bd60cde244559a823a47293540f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:38.375316 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-beffcf76-f642-4d05-a8fb-3f1c0c240b0f tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] 10.222.0.32 "GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e" status: 200 len: 1754 microversion: 2.1 time: 0.165776 May 30 12:12:38.375895 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 455/921] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:12:38 2022] GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e => generated 1754 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:12:39.393468 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-4d8479c8-7c83-4b42-b5cb-6c05ffb50760 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:39.394085 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-4d8479c8-7c83-4b42-b5cb-6c05ffb50760 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] [instance: 4eb46ab6-5aba-438a-b5d0-b04d6ddee02e] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:39.401386 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4d8479c8-7c83-4b42-b5cb-6c05ffb50760 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:39.401841 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4d8479c8-7c83-4b42-b5cb-6c05ffb50760 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:39.402609 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4d8479c8-7c83-4b42-b5cb-6c05ffb50760 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:39.403045 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4d8479c8-7c83-4b42-b5cb-6c05ffb50760 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:39.548266 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-4d8479c8-7c83-4b42-b5cb-6c05ffb50760 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8915c74c4d24d2cb1cded5aa7927120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc19bd60cde244559a823a47293540f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:39.556877 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-4d8479c8-7c83-4b42-b5cb-6c05ffb50760 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] 10.222.0.32 "GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e" status: 200 len: 1757 microversion: 2.1 time: 0.167500 May 30 12:12:39.557444 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 467/922] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:12:39 2022] GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:13:18.079611 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-20775fdd-fa36-4b5c-a89b-8c2d20da6d64 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-55921125"}} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:13:18.080438 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-20775fdd-fa36-4b5c-a89b-8c2d20da6d64 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] [instance: 4eb46ab6-5aba-438a-b5d0-b04d6ddee02e] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:18.082415 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_api:SELECT=20 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:13:18.083060 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell1:SELECT=60 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:13:18.089523 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-20775fdd-fa36-4b5c-a89b-8c2d20da6d64 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:18.089967 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-20775fdd-fa36-4b5c-a89b-8c2d20da6d64 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:18.090732 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-20775fdd-fa36-4b5c-a89b-8c2d20da6d64 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:18.091165 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-20775fdd-fa36-4b5c-a89b-8c2d20da6d64 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:18.217565 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.network.security_group_api [None req-20775fdd-fa36-4b5c-a89b-8c2d20da6d64 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Removing security group db775c86-ece9-48e3-99d3-7a447f58571b from port a3736af0-e6ce-4bc1-adc2-3c3c8417fdb9 May 30 12:13:18.595331 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-20775fdd-fa36-4b5c-a89b-8c2d20da6d64 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] 10.222.0.32 "POST /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e/action" status: 202 len: 0 microversion: 2.1 time: 0.519660 May 30 12:13:18.603879 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-284ee444-c327-4814-b57e-17b522f36c0d req-4e43b2d0-1674-464a-b537-3534fccfa4d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4eb46ab6-5aba-438a-b5d0-b04d6ddee02e", "tag": "a3736af0-e6ce-4bc1-adc2-3c3c8417fdb9"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:13:18.607306 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 456/923] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 30 12:13:18 2022] POST /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e/action => generated 0 bytes in 532 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 30 12:13:18.607677 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_api:SELECT=22 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:13:18.611419 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:13:18.620343 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-284ee444-c327-4814-b57e-17b522f36c0d req-4e43b2d0-1674-464a-b537-3534fccfa4d1 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:18.621186 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-284ee444-c327-4814-b57e-17b522f36c0d req-4e43b2d0-1674-464a-b537-3534fccfa4d1 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:18.650934 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-284ee444-c327-4814-b57e-17b522f36c0d req-4e43b2d0-1674-464a-b537-3534fccfa4d1 service nova] Creating event network-changed:a3736af0-e6ce-4bc1-adc2-3c3c8417fdb9 for instance 4eb46ab6-5aba-438a-b5d0-b04d6ddee02e on hv-cinder-84051 May 30 12:13:18.657280 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-284ee444-c327-4814-b57e-17b522f36c0d req-4e43b2d0-1674-464a-b537-3534fccfa4d1 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057681 May 30 12:13:18.658345 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 468/924] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:13:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 30 12:13:19.785370 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-ed900e75-643d-4e3d-a430-f751f0fe077f tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:19.785969 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-ed900e75-643d-4e3d-a430-f751f0fe077f tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] [instance: 4eb46ab6-5aba-438a-b5d0-b04d6ddee02e] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:19.792815 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ed900e75-643d-4e3d-a430-f751f0fe077f tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:19.793363 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ed900e75-643d-4e3d-a430-f751f0fe077f tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:19.794916 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ed900e75-643d-4e3d-a430-f751f0fe077f tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:19.795454 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ed900e75-643d-4e3d-a430-f751f0fe077f tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:19.879205 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.objects.instance [None req-ed900e75-643d-4e3d-a430-f751f0fe077f tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lazy-loading 'services' on Instance uuid 4eb46ab6-5aba-438a-b5d0-b04d6ddee02e {{(pid=117670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 30 12:13:19.955981 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-ed900e75-643d-4e3d-a430-f751f0fe077f tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] 10.222.0.32 "DELETE /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e/os-volume_attachments/9c800c43-36ea-42e1-bab2-6f0840049f9c" status: 202 len: 0 microversion: 2.1 time: 0.174925 May 30 12:13:19.956604 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 457/925] 10.222.0.32 () {58 vars in 1415 bytes} [Mon May 30 12:13:19 2022] DELETE /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e/os-volume_attachments/9c800c43-36ea-42e1-bab2-6f0840049f9c => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 30 12:13:19.968371 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-20f8efb5-cabd-4551-bf35-baeb65501d08 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:19.969532 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-20f8efb5-cabd-4551-bf35-baeb65501d08 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] [instance: 4eb46ab6-5aba-438a-b5d0-b04d6ddee02e] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:19.976645 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-20f8efb5-cabd-4551-bf35-baeb65501d08 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:19.977886 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-20f8efb5-cabd-4551-bf35-baeb65501d08 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:19.979326 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-20f8efb5-cabd-4551-bf35-baeb65501d08 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:19.979763 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-20f8efb5-cabd-4551-bf35-baeb65501d08 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:20.013104 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-20f8efb5-cabd-4551-bf35-baeb65501d08 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] 10.222.0.32 "GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049971 May 30 12:13:20.013701 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 469/926] 10.222.0.32 () {58 vars in 1301 bytes} [Mon May 30 12:13:19 2022] GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:13:20.673377 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-268935a4-9e67-4f25-9ca1-fa02aca0d910 req-c5028f9c-2d88-4bc8-aec6-7b04d3b4ec95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4eb46ab6-5aba-438a-b5d0-b04d6ddee02e", "tag": "a3736af0-e6ce-4bc1-adc2-3c3c8417fdb9"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:13:20.681759 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-268935a4-9e67-4f25-9ca1-fa02aca0d910 req-c5028f9c-2d88-4bc8-aec6-7b04d3b4ec95 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:20.682195 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-268935a4-9e67-4f25-9ca1-fa02aca0d910 req-c5028f9c-2d88-4bc8-aec6-7b04d3b4ec95 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:20.692894 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-268935a4-9e67-4f25-9ca1-fa02aca0d910 req-c5028f9c-2d88-4bc8-aec6-7b04d3b4ec95 service nova] Creating event network-changed:a3736af0-e6ce-4bc1-adc2-3c3c8417fdb9 for instance 4eb46ab6-5aba-438a-b5d0-b04d6ddee02e on hv-cinder-84051 May 30 12:13:20.698087 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-268935a4-9e67-4f25-9ca1-fa02aca0d910 req-c5028f9c-2d88-4bc8-aec6-7b04d3b4ec95 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028739 May 30 12:13:20.698671 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 458/927] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:13:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:13:21.026240 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-2e17b9b9-053a-43d4-a799-4c7852b22352 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:21.027194 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-2e17b9b9-053a-43d4-a799-4c7852b22352 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] [instance: 4eb46ab6-5aba-438a-b5d0-b04d6ddee02e] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:21.033915 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2e17b9b9-053a-43d4-a799-4c7852b22352 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:21.034365 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2e17b9b9-053a-43d4-a799-4c7852b22352 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:21.035169 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2e17b9b9-053a-43d4-a799-4c7852b22352 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:21.035569 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2e17b9b9-053a-43d4-a799-4c7852b22352 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:21.064810 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-2e17b9b9-053a-43d4-a799-4c7852b22352 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] 10.222.0.32 "GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043292 May 30 12:13:21.065380 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 470/928] 10.222.0.32 () {58 vars in 1301 bytes} [Mon May 30 12:13:21 2022] GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 30 12:13:21.077092 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-a3c4d69d-f000-49eb-a82d-ac95534e3ef4 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:21.077908 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-a3c4d69d-f000-49eb-a82d-ac95534e3ef4 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] [instance: 4eb46ab6-5aba-438a-b5d0-b04d6ddee02e] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:21.086117 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a3c4d69d-f000-49eb-a82d-ac95534e3ef4 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:21.086117 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a3c4d69d-f000-49eb-a82d-ac95534e3ef4 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:21.087582 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a3c4d69d-f000-49eb-a82d-ac95534e3ef4 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:21.088360 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a3c4d69d-f000-49eb-a82d-ac95534e3ef4 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:21.168176 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.wsgi [None req-a3c4d69d-f000-49eb-a82d-ac95534e3ef4 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] HTTP exception thrown: Instance 4eb46ab6-5aba-438a-b5d0-b04d6ddee02e is not attached to volume 9c800c43-36ea-42e1-bab2-6f0840049f9c May 30 12:13:21.177710 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-a3c4d69d-f000-49eb-a82d-ac95534e3ef4 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Request method failure captured: May 30 12:13:21.177710 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: request: DELETE /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e/os-volume_attachments/9c800c43-36ea-42e1-bab2-6f0840049f9c HTTP/1.1 May 30 12:13:21.177710 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Accept: application/json May 30 12:13:21.177710 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Accept-Encoding: identity May 30 12:13:21.177710 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Connection: close May 30 12:13:21.177710 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Content-Length: 0 May 30 12:13:21.177710 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Content-Type: application/json May 30 12:13:21.177710 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Host: 10.222.0.32 May 30 12:13:21.177710 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Openstack-System-Scope: None May 30 12:13:21.177710 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: User-Agent: python-urllib3/1.26.9 May 30 12:13:21.177710 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Auth-Token: gAAAAABilLRMHBu98j1dbSrL-4gi_bQVUOWh5qTAJFTYaKRzEkQ0275zmMt2GjOeks9LP1tHiq5y8mC0G-XoNdCfCV-oQiPbKOne16ipA9w1vCJyvdaq4AprhdhIEjMAT2P32ym7OeS6RMYO_0aYl31lon9eVhnzTUYLCU50spRbQaPLZoV5e7w May 30 12:13:21.177710 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Domain-Id: None May 30 12:13:21.177710 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Domain-Name: None May 30 12:13:21.177710 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Identity-Status: Confirmed May 30 12:13:21.177710 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Is-Admin-Project: True May 30 12:13:21.177710 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Domain-Id: default May 30 12:13:21.177710 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Domain-Name: Default May 30 12:13:21.177710 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Id: dc19bd60cde244559a823a47293540f7 May 30 12:13:21.177710 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Name: tempest-TestMinimumBasicScenario-1181441056 May 30 12:13:21.177710 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Role: reader,member May 30 12:13:21.177710 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Roles: reader,member May 30 12:13:21.179421 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/dc19bd60cde244559a823a47293540f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/dc19bd60cde244559a823a47293540f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/dc19bd60cde244559a823a47293540f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_dc19bd60cde244559a823a47293540f7", "adminURL": "http://10.222.0.32:8080"}]}] May 30 12:13:21.179421 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant: tempest-TestMinimumBasicScenario-1181441056 May 30 12:13:21.179421 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant-Id: dc19bd60cde244559a823a47293540f7 May 30 12:13:21.179421 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1181441056 May 30 12:13:21.179421 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User: tempest-TestMinimumBasicScenario-1181441056-project May 30 12:13:21.179421 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Domain-Id: default May 30 12:13:21.179421 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Domain-Name: Default May 30 12:13:21.179421 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Id: c8915c74c4d24d2cb1cded5aa7927120 May 30 12:13:21.179421 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Name: tempest-TestMinimumBasicScenario-1181441056-project May 30 12:13:21.179421 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: method: > May 30 12:13:21.179421 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: exception: Instance 4eb46ab6-5aba-438a-b5d0-b04d6ddee02e is not attached to volume 9c800c43-36ea-42e1-bab2-6f0840049f9c May 30 12:13:21.181221 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: action_args: {'server_id': '4eb46ab6-5aba-438a-b5d0-b04d6ddee02e', 'id': '9c800c43-36ea-42e1-bab2-6f0840049f9c'} May 30 12:13:21.181221 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:13:21.181221 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:13:21.181221 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 30 12:13:21.181221 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 30 12:13:21.181221 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 30 12:13:21.181221 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 30 12:13:21.181221 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 30 12:13:21.181221 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 30 12:13:21.181221 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 9c800c43-36ea-42e1-bab2-6f0840049f9c. May 30 12:13:21.181221 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:13:21.181221 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:13:21.181221 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:13:21.181221 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:13:21.181221 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:13:21.181221 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:13:21.181221 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:13:21.181221 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:13:21.181221 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:13:21.182887 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:13:21.182887 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 30 12:13:21.182887 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 30 12:13:21.182887 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4eb46ab6-5aba-438a-b5d0-b04d6ddee02e is not attached to volume 9c800c43-36ea-42e1-bab2-6f0840049f9c May 30 12:13:21.182887 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:13:21.182887 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:13:21.182887 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:13:21.182887 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:13:21.182887 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:13:21.182887 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:13:21.182887 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:13:21.182887 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:13:21.182887 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4eb46ab6-5aba-438a-b5d0-b04d6ddee02e is not attached to volume 9c800c43-36ea-42e1-bab2-6f0840049f9c May 30 12:13:21.182887 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:13:21.182887 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-a3c4d69d-f000-49eb-a82d-ac95534e3ef4 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Returning 404 to user: Instance 4eb46ab6-5aba-438a-b5d0-b04d6ddee02e is not attached to volume 9c800c43-36ea-42e1-bab2-6f0840049f9c {{(pid=117670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:13:21.184071 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-a3c4d69d-f000-49eb-a82d-ac95534e3ef4 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] 10.222.0.32 "DELETE /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e/os-volume_attachments/9c800c43-36ea-42e1-bab2-6f0840049f9c" status: 404 len: 154 microversion: 2.1 time: 0.107043 May 30 12:13:21.184071 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 459/929] 10.222.0.32 () {58 vars in 1415 bytes} [Mon May 30 12:13:21 2022] DELETE /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e/os-volume_attachments/9c800c43-36ea-42e1-bab2-6f0840049f9c => generated 154 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 30 12:13:22.319143 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-c1b43d3f-496e-45f0-ac8d-03efcc333c7f tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:22.319634 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-c1b43d3f-496e-45f0-ac8d-03efcc333c7f tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] [instance: 4eb46ab6-5aba-438a-b5d0-b04d6ddee02e] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:22.326973 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c1b43d3f-496e-45f0-ac8d-03efcc333c7f tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:22.327432 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c1b43d3f-496e-45f0-ac8d-03efcc333c7f tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:22.328267 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c1b43d3f-496e-45f0-ac8d-03efcc333c7f tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:22.328709 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c1b43d3f-496e-45f0-ac8d-03efcc333c7f tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:22.354153 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-c1b43d3f-496e-45f0-ac8d-03efcc333c7f tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] [instance: 4eb46ab6-5aba-438a-b5d0-b04d6ddee02e] Going to try to terminate instance {{(pid=117671) delete /opt/stack/nova/nova/compute/api.py:2664}} May 30 12:13:22.432472 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-c1b43d3f-496e-45f0-ac8d-03efcc333c7f tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] 10.222.0.32 "DELETE /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e" status: 204 len: 0 microversion: 2.1 time: 0.116716 May 30 12:13:22.433302 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 471/930] 10.222.0.32 () {58 vars in 1238 bytes} [Mon May 30 12:13:22 2022] DELETE /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 30 12:13:22.442945 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-f79a4f3a-2825-4e7d-8d2b-6a4e6d29cb45 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:22.443558 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-f79a4f3a-2825-4e7d-8d2b-6a4e6d29cb45 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] [instance: 4eb46ab6-5aba-438a-b5d0-b04d6ddee02e] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:22.451050 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f79a4f3a-2825-4e7d-8d2b-6a4e6d29cb45 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:22.451504 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f79a4f3a-2825-4e7d-8d2b-6a4e6d29cb45 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:22.452310 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f79a4f3a-2825-4e7d-8d2b-6a4e6d29cb45 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:22.452750 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f79a4f3a-2825-4e7d-8d2b-6a4e6d29cb45 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:22.583606 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-f79a4f3a-2825-4e7d-8d2b-6a4e6d29cb45 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8915c74c4d24d2cb1cded5aa7927120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc19bd60cde244559a823a47293540f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:22.592173 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-f79a4f3a-2825-4e7d-8d2b-6a4e6d29cb45 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] 10.222.0.32 "GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e" status: 200 len: 1553 microversion: 2.1 time: 0.153099 May 30 12:13:22.592757 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 460/931] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:13:22 2022] GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:13:23.611420 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-adb74b20-75c8-47e8-8207-d6c264b87e18 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:23.612120 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-adb74b20-75c8-47e8-8207-d6c264b87e18 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] [instance: 4eb46ab6-5aba-438a-b5d0-b04d6ddee02e] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:23.618672 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-adb74b20-75c8-47e8-8207-d6c264b87e18 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:23.619130 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-adb74b20-75c8-47e8-8207-d6c264b87e18 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:23.619903 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-adb74b20-75c8-47e8-8207-d6c264b87e18 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:23.620383 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-adb74b20-75c8-47e8-8207-d6c264b87e18 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:23.748933 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-adb74b20-75c8-47e8-8207-d6c264b87e18 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8915c74c4d24d2cb1cded5aa7927120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc19bd60cde244559a823a47293540f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:23.756510 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-adb74b20-75c8-47e8-8207-d6c264b87e18 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] 10.222.0.32 "GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e" status: 200 len: 1553 microversion: 2.1 time: 0.150265 May 30 12:13:23.757079 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 472/932] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:13:23 2022] GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e => generated 1553 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:13:24.774635 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-ead90bce-d1c1-416f-a7c4-2925a8414cf9 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:24.775740 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-ead90bce-d1c1-416f-a7c4-2925a8414cf9 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] [instance: 4eb46ab6-5aba-438a-b5d0-b04d6ddee02e] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:24.782133 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ead90bce-d1c1-416f-a7c4-2925a8414cf9 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:24.782583 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ead90bce-d1c1-416f-a7c4-2925a8414cf9 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:24.783419 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ead90bce-d1c1-416f-a7c4-2925a8414cf9 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:24.783797 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ead90bce-d1c1-416f-a7c4-2925a8414cf9 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:24.918402 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-ead90bce-d1c1-416f-a7c4-2925a8414cf9 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8915c74c4d24d2cb1cded5aa7927120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc19bd60cde244559a823a47293540f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:24.926400 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-ead90bce-d1c1-416f-a7c4-2925a8414cf9 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] 10.222.0.32 "GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e" status: 200 len: 1553 microversion: 2.1 time: 0.155505 May 30 12:13:24.934125 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 461/933] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:13:24 2022] GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e => generated 1553 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:13:24.967937 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-06dc9bf5-dd8b-4fa7-8129-155732b8a7eb req-ae8c0f1f-235c-43b1-beb4-0f6a6176c1ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eb46ab6-5aba-438a-b5d0-b04d6ddee02e", "name": "network-vif-deleted", "tag": "a3736af0-e6ce-4bc1-adc2-3c3c8417fdb9"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:13:24.976570 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-06dc9bf5-dd8b-4fa7-8129-155732b8a7eb req-ae8c0f1f-235c-43b1-beb4-0f6a6176c1ec service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:24.977214 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-06dc9bf5-dd8b-4fa7-8129-155732b8a7eb req-ae8c0f1f-235c-43b1-beb4-0f6a6176c1ec service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:24.990206 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-06dc9bf5-dd8b-4fa7-8129-155732b8a7eb req-ae8c0f1f-235c-43b1-beb4-0f6a6176c1ec service nova] Creating event network-vif-deleted:a3736af0-e6ce-4bc1-adc2-3c3c8417fdb9 for instance 4eb46ab6-5aba-438a-b5d0-b04d6ddee02e on hv-cinder-84051 May 30 12:13:24.995721 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-06dc9bf5-dd8b-4fa7-8129-155732b8a7eb req-ae8c0f1f-235c-43b1-beb4-0f6a6176c1ec service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031435 May 30 12:13:24.996427 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 473/934] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:13:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:13:25.945340 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-7f4a54fe-acd4-4e50-af0b-eccf4693a930 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:25.946139 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-7f4a54fe-acd4-4e50-af0b-eccf4693a930 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] [instance: 4eb46ab6-5aba-438a-b5d0-b04d6ddee02e] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:25.953989 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7f4a54fe-acd4-4e50-af0b-eccf4693a930 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:25.954439 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7f4a54fe-acd4-4e50-af0b-eccf4693a930 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:25.955249 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7f4a54fe-acd4-4e50-af0b-eccf4693a930 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:25.955690 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7f4a54fe-acd4-4e50-af0b-eccf4693a930 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:25.973640 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.wsgi [None req-7f4a54fe-acd4-4e50-af0b-eccf4693a930 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] HTTP exception thrown: Instance 4eb46ab6-5aba-438a-b5d0-b04d6ddee02e could not be found. May 30 12:13:25.975286 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-7f4a54fe-acd4-4e50-af0b-eccf4693a930 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Request method failure captured: May 30 12:13:25.975286 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: request: GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e HTTP/1.1 May 30 12:13:25.975286 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Accept: application/json May 30 12:13:25.975286 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Accept-Encoding: identity May 30 12:13:25.975286 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Connection: close May 30 12:13:25.975286 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Content-Length: 0 May 30 12:13:25.975286 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Content-Type: application/json May 30 12:13:25.975286 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Host: 10.222.0.32 May 30 12:13:25.975286 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Openstack-System-Scope: None May 30 12:13:25.975286 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: User-Agent: python-urllib3/1.26.9 May 30 12:13:25.975286 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Auth-Token: gAAAAABilLRMHBu98j1dbSrL-4gi_bQVUOWh5qTAJFTYaKRzEkQ0275zmMt2GjOeks9LP1tHiq5y8mC0G-XoNdCfCV-oQiPbKOne16ipA9w1vCJyvdaq4AprhdhIEjMAT2P32ym7OeS6RMYO_0aYl31lon9eVhnzTUYLCU50spRbQaPLZoV5e7w May 30 12:13:25.975286 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Domain-Id: None May 30 12:13:25.975286 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Domain-Name: None May 30 12:13:25.975286 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Identity-Status: Confirmed May 30 12:13:25.975286 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Is-Admin-Project: True May 30 12:13:25.975286 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Domain-Id: default May 30 12:13:25.975286 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Domain-Name: Default May 30 12:13:25.975286 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Id: dc19bd60cde244559a823a47293540f7 May 30 12:13:25.975286 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Name: tempest-TestMinimumBasicScenario-1181441056 May 30 12:13:25.975286 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Role: reader,member May 30 12:13:25.975286 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Roles: reader,member May 30 12:13:25.977268 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/dc19bd60cde244559a823a47293540f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/dc19bd60cde244559a823a47293540f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/dc19bd60cde244559a823a47293540f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_dc19bd60cde244559a823a47293540f7", "adminURL": "http://10.222.0.32:8080"}]}] May 30 12:13:25.977268 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant: tempest-TestMinimumBasicScenario-1181441056 May 30 12:13:25.977268 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant-Id: dc19bd60cde244559a823a47293540f7 May 30 12:13:25.977268 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1181441056 May 30 12:13:25.977268 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User: tempest-TestMinimumBasicScenario-1181441056-project May 30 12:13:25.977268 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Domain-Id: default May 30 12:13:25.977268 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Domain-Name: Default May 30 12:13:25.977268 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Id: c8915c74c4d24d2cb1cded5aa7927120 May 30 12:13:25.977268 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Name: tempest-TestMinimumBasicScenario-1181441056-project May 30 12:13:25.977268 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: method: > May 30 12:13:25.977268 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: exception: Instance 4eb46ab6-5aba-438a-b5d0-b04d6ddee02e could not be found. May 30 12:13:25.977268 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: action_args: {'id': '4eb46ab6-5aba-438a-b5d0-b04d6ddee02e'} May 30 12:13:25.978881 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:13:25.978881 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:13:25.978881 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:13:25.978881 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:13:25.978881 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:13:25.978881 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:13:25.978881 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:13:25.978881 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:13:25.978881 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:13:25.978881 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:13:25.978881 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4eb46ab6-5aba-438a-b5d0-b04d6ddee02e could not be found. May 30 12:13:25.978881 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:13:25.978881 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:13:25.978881 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:13:25.978881 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:13:25.978881 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:13:25.978881 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:13:25.978881 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:13:25.978881 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:13:25.978881 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:13:25.980438 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:13:25.980438 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 30 12:13:25.980438 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 30 12:13:25.980438 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 30 12:13:25.980438 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 30 12:13:25.980438 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:13:25.980438 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:13:25.980438 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4eb46ab6-5aba-438a-b5d0-b04d6ddee02e could not be found. May 30 12:13:25.980438 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:13:25.980438 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:13:25.980438 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:13:25.980438 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:13:25.980438 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:13:25.980438 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:13:25.980438 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:13:25.980438 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:13:25.980438 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4eb46ab6-5aba-438a-b5d0-b04d6ddee02e could not be found. May 30 12:13:25.980438 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:13:25.981863 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-7f4a54fe-acd4-4e50-af0b-eccf4693a930 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Returning 404 to user: Instance 4eb46ab6-5aba-438a-b5d0-b04d6ddee02e could not be found. {{(pid=117670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:13:25.981863 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-7f4a54fe-acd4-4e50-af0b-eccf4693a930 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] 10.222.0.32 "GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e" status: 404 len: 111 microversion: 2.1 time: 0.036183 May 30 12:13:25.981863 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 462/935] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:13:25 2022] GET /compute/v2.1/servers/4eb46ab6-5aba-438a-b5d0-b04d6ddee02e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 30 12:13:25.987105 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-0aef5ec0-c1b9-4e4a-8c15-17644e366b36 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] Calling method '.version_select at 0x7f0ef8a4d430>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:26.007885 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-0aef5ec0-c1b9-4e4a-8c15-17644e366b36 tempest-TestMinimumBasicScenario-1181441056 tempest-TestMinimumBasicScenario-1181441056-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-486287668" status: 202 len: 0 microversion: 2.1 time: 0.025377 May 30 12:13:26.008513 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 474/936] 10.222.0.32 () {58 vars in 1268 bytes} [Mon May 30 12:13:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-486287668 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 30 12:13:44.158773 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_api:SELECT=14 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:13:44.159578 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell1:SELECT=35,nova_cell1:INSERT=1 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:13:44.367566 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-f9b4315e-25db-4b7a-ac19-14c7eecd929d tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Action: 'create', calling method: .version_select at 0x7f0ef87e5ca0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1163141210", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC8eZVtN4XMgMwrG5w+0rplbl711xMuhaN0ufy8g7+x1fIEsrYehrT32ugl8DvdMyWsteVexGZ0Gt8fMBtdjPMRj85I0iduNr5WLooHuioDaqxalKSw6Xrn2KX/ToHxiCQ=="}} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:13:44.381937 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.quota [None req-f9b4315e-25db-4b7a-ac19-14c7eecd929d tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Getting quotas for project 7ab20a59f54348e6b0d892ea010aff9c. Resources: {'key_pairs'} {{(pid=117670) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 30 12:13:44.386295 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.quota [None req-f9b4315e-25db-4b7a-ac19-14c7eecd929d tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Getting quotas for user 7fce4b25aa88412590502ccbc8ce0690 and project 7ab20a59f54348e6b0d892ea010aff9c. Resources: {'key_pairs'} {{(pid=117670) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 30 12:13:44.399426 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f9b4315e-25db-4b7a-ac19-14c7eecd929d tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] [191eadee-2e17-4267-b3f4-8ac1df814c1b] AMQP server on 10.222.0.32:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 30 12:13:45.407570 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO oslo.messaging._drivers.impl_rabbit [None req-f9b4315e-25db-4b7a-ac19-14c7eecd929d tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] [191eadee-2e17-4267-b3f4-8ac1df814c1b] Reconnected to AMQP server on 10.222.0.32:5672 via [amqp] client with port 58176. May 30 12:13:45.425748 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-f9b4315e-25db-4b7a-ac19-14c7eecd929d tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 1.271797 May 30 12:13:45.426364 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 463/937] 10.222.0.32 () {60 vars in 1158 bytes} [Mon May 30 12:13:44 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:14:02.601433 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:02.602242 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:02.606168 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-95f68836-1445-4b0f-bf72-316ad378e9be tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-438382870", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1163141210", "security_groups": [{"name": "tempest-secgroup-smoke-426332048"}], "networks": [{"uuid": "ce5c8f6f-8c28-4518-9a07-1331ddd810ef"}], "block_device_mapping_v2": [{"uuid": "a151a737-3edd-4c7f-b7e9-ae553730c574", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:14:02.725669 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.network.neutron [None req-95f68836-1445-4b0f-bf72-316ad378e9be tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] validate_networks() for [('ce5c8f6f-8c28-4518-9a07-1331ddd810ef', None, None, None, None, None)] {{(pid=117671) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 30 12:14:03.181566 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-95f68836-1445-4b0f-bf72-316ad378e9be tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Flavor limits 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 30 12:14:03.181986 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-95f68836-1445-4b0f-bf72-316ad378e9be tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Image limits 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 30 12:14:03.182455 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-95f68836-1445-4b0f-bf72-316ad378e9be tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Flavor pref 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 30 12:14:03.182879 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-95f68836-1445-4b0f-bf72-316ad378e9be tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Image pref 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 30 12:14:03.183284 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-95f68836-1445-4b0f-bf72-316ad378e9be tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 30 12:14:03.192998 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-95f68836-1445-4b0f-bf72-316ad378e9be tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:03.193438 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-95f68836-1445-4b0f-bf72-316ad378e9be tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:03.194224 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-95f68836-1445-4b0f-bf72-316ad378e9be tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:03.194656 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-95f68836-1445-4b0f-bf72-316ad378e9be tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:03.211962 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.quota [None req-95f68836-1445-4b0f-bf72-316ad378e9be tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Getting quotas for project 7ab20a59f54348e6b0d892ea010aff9c. Resources: {'cores', 'instances', 'ram'} {{(pid=117671) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 30 12:14:03.216278 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.quota [None req-95f68836-1445-4b0f-bf72-316ad378e9be tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Getting quotas for user 7fce4b25aa88412590502ccbc8ce0690 and project 7ab20a59f54348e6b0d892ea010aff9c. Resources: {'cores', 'instances', 'ram'} {{(pid=117671) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 30 12:14:03.274973 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-95f68836-1445-4b0f-bf72-316ad378e9be tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Going to run 1 instances... {{(pid=117671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 30 12:14:03.277285 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-95f68836-1445-4b0f-bf72-316ad378e9be tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] [instance: 030b59c9-1f3f-41b3-af99-1631ad0710f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a151a737-3edd-4c7f-b7e9-ae553730c574',volume_size=None,volume_type=None)] {{(pid=117671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 30 12:14:03.413889 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-95f68836-1445-4b0f-bf72-316ad378e9be tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.813943 May 30 12:14:03.414526 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 475/938] 10.222.0.32 () {60 vars in 1146 bytes} [Mon May 30 12:14:02 2022] POST /compute/v2.1/servers => generated 405 bytes in 815 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 30 12:14:03.422509 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell0:SELECT=4 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:03.423385 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:03.427047 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-9bb457b3-741b-45e6-a349-73743a275d51 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:14:03.427655 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-9bb457b3-741b-45e6-a349-73743a275d51 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] [instance: 030b59c9-1f3f-41b3-af99-1631ad0710f7] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:14:03.483224 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-9bb457b3-741b-45e6-a349-73743a275d51 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce4b25aa88412590502ccbc8ce0690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab20a59f54348e6b0d892ea010aff9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:14:03.489887 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-9bb457b3-741b-45e6-a349-73743a275d51 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] 10.222.0.32 "GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7" status: 200 len: 1088 microversion: 2.1 time: 0.068642 May 30 12:14:03.490457 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 464/939] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:14:03 2022] GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7 => generated 1088 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:14:04.508074 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-74f95707-7f86-4633-bccf-c2dbb6509410 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:14:04.508722 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-74f95707-7f86-4633-bccf-c2dbb6509410 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] [instance: 030b59c9-1f3f-41b3-af99-1631ad0710f7] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:14:04.516484 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-74f95707-7f86-4633-bccf-c2dbb6509410 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:04.517167 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-74f95707-7f86-4633-bccf-c2dbb6509410 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:04.518331 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-74f95707-7f86-4633-bccf-c2dbb6509410 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:04.518997 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-74f95707-7f86-4633-bccf-c2dbb6509410 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:04.582488 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-74f95707-7f86-4633-bccf-c2dbb6509410 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce4b25aa88412590502ccbc8ce0690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab20a59f54348e6b0d892ea010aff9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:14:04.590027 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-74f95707-7f86-4633-bccf-c2dbb6509410 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] 10.222.0.32 "GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7" status: 200 len: 1138 microversion: 2.1 time: 0.086346 May 30 12:14:04.590602 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 476/940] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:14:04 2022] GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7 => generated 1138 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:14:05.607525 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-44f63efb-d3e9-459f-bc8d-56056fadc180 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:14:05.608146 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-44f63efb-d3e9-459f-bc8d-56056fadc180 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] [instance: 030b59c9-1f3f-41b3-af99-1631ad0710f7] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:14:05.615057 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-44f63efb-d3e9-459f-bc8d-56056fadc180 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:05.615780 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-44f63efb-d3e9-459f-bc8d-56056fadc180 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:05.616591 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-44f63efb-d3e9-459f-bc8d-56056fadc180 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:05.617031 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-44f63efb-d3e9-459f-bc8d-56056fadc180 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:05.686007 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-44f63efb-d3e9-459f-bc8d-56056fadc180 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce4b25aa88412590502ccbc8ce0690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab20a59f54348e6b0d892ea010aff9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:14:05.693784 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-44f63efb-d3e9-459f-bc8d-56056fadc180 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] 10.222.0.32 "GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7" status: 200 len: 1204 microversion: 2.1 time: 0.090768 May 30 12:14:05.694354 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 465/941] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:14:05 2022] GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7 => generated 1204 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:14:06.711209 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-3ccf03fe-7525-4848-8424-9d273547c2ca tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:14:06.711928 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-3ccf03fe-7525-4848-8424-9d273547c2ca tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] [instance: 030b59c9-1f3f-41b3-af99-1631ad0710f7] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:14:06.720077 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3ccf03fe-7525-4848-8424-9d273547c2ca tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:06.720614 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3ccf03fe-7525-4848-8424-9d273547c2ca tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:06.721934 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3ccf03fe-7525-4848-8424-9d273547c2ca tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:06.722443 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3ccf03fe-7525-4848-8424-9d273547c2ca tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:06.859391 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-e969e51d-b3e3-4f80-88d8-8f234a5383fe req-361e8fe3-8760-4311-b540-6fe9df2c16e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "030b59c9-1f3f-41b3-af99-1631ad0710f7", "tag": "36466e57-98c5-4029-b86f-9faa0fa79ccd"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:14:06.883394 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-3ccf03fe-7525-4848-8424-9d273547c2ca tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce4b25aa88412590502ccbc8ce0690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab20a59f54348e6b0d892ea010aff9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:14:06.895767 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-3ccf03fe-7525-4848-8424-9d273547c2ca tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] 10.222.0.32 "GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7" status: 200 len: 1259 microversion: 2.1 time: 0.188562 May 30 12:14:06.900653 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 477/942] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:14:06 2022] GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7 => generated 1259 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:14:06.901121 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-e969e51d-b3e3-4f80-88d8-8f234a5383fe req-361e8fe3-8760-4311-b540-6fe9df2c16e8 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:06.901572 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-e969e51d-b3e3-4f80-88d8-8f234a5383fe req-361e8fe3-8760-4311-b540-6fe9df2c16e8 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:06.926718 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-e969e51d-b3e3-4f80-88d8-8f234a5383fe req-361e8fe3-8760-4311-b540-6fe9df2c16e8 service nova] Creating event network-changed:36466e57-98c5-4029-b86f-9faa0fa79ccd for instance 030b59c9-1f3f-41b3-af99-1631ad0710f7 on hv-cinder-84051 May 30 12:14:06.934135 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-e969e51d-b3e3-4f80-88d8-8f234a5383fe req-361e8fe3-8760-4311-b540-6fe9df2c16e8 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083260 May 30 12:14:06.935106 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 466/943] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:14:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 30 12:14:07.916746 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-9a6cdd30-6b88-4598-a81a-cfa59805f901 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:14:07.917349 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-9a6cdd30-6b88-4598-a81a-cfa59805f901 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] [instance: 030b59c9-1f3f-41b3-af99-1631ad0710f7] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:14:07.923751 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9a6cdd30-6b88-4598-a81a-cfa59805f901 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:07.924225 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9a6cdd30-6b88-4598-a81a-cfa59805f901 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:07.925017 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9a6cdd30-6b88-4598-a81a-cfa59805f901 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:07.925849 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9a6cdd30-6b88-4598-a81a-cfa59805f901 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:08.060473 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-9a6cdd30-6b88-4598-a81a-cfa59805f901 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce4b25aa88412590502ccbc8ce0690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab20a59f54348e6b0d892ea010aff9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:14:08.068108 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-9a6cdd30-6b88-4598-a81a-cfa59805f901 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] 10.222.0.32 "GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7" status: 200 len: 1259 microversion: 2.1 time: 0.155079 May 30 12:14:08.068502 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 478/944] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:14:07 2022] GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:14:09.085630 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-32030b9a-4513-4ac6-9aa2-7a6bf4e4195a tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:14:09.086321 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-32030b9a-4513-4ac6-9aa2-7a6bf4e4195a tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] [instance: 030b59c9-1f3f-41b3-af99-1631ad0710f7] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:14:09.093426 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-32030b9a-4513-4ac6-9aa2-7a6bf4e4195a tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:09.093870 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-32030b9a-4513-4ac6-9aa2-7a6bf4e4195a tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:09.094630 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-32030b9a-4513-4ac6-9aa2-7a6bf4e4195a tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:09.095059 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-32030b9a-4513-4ac6-9aa2-7a6bf4e4195a tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:09.235561 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-32030b9a-4513-4ac6-9aa2-7a6bf4e4195a tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce4b25aa88412590502ccbc8ce0690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab20a59f54348e6b0d892ea010aff9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:14:09.243097 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-32030b9a-4513-4ac6-9aa2-7a6bf4e4195a tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] 10.222.0.32 "GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7" status: 200 len: 1259 microversion: 2.1 time: 0.161630 May 30 12:14:09.243674 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 467/945] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:14:09 2022] GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7 => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:14:10.260396 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-b0c65461-ba58-44cd-b68b-a93314409f97 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:14:10.260935 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-b0c65461-ba58-44cd-b68b-a93314409f97 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] [instance: 030b59c9-1f3f-41b3-af99-1631ad0710f7] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:14:10.268084 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b0c65461-ba58-44cd-b68b-a93314409f97 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:10.268564 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b0c65461-ba58-44cd-b68b-a93314409f97 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:10.269327 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b0c65461-ba58-44cd-b68b-a93314409f97 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:10.270018 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b0c65461-ba58-44cd-b68b-a93314409f97 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:10.456623 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-b0c65461-ba58-44cd-b68b-a93314409f97 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce4b25aa88412590502ccbc8ce0690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab20a59f54348e6b0d892ea010aff9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:14:10.464064 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-b0c65461-ba58-44cd-b68b-a93314409f97 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] 10.222.0.32 "GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7" status: 200 len: 1259 microversion: 2.1 time: 0.207634 May 30 12:14:10.464922 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 479/946] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:14:10 2022] GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7 => generated 1259 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:14:11.482439 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-0a35cbda-0a0e-4185-9a8c-a498ee28fa94 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:14:11.483056 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-0a35cbda-0a0e-4185-9a8c-a498ee28fa94 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] [instance: 030b59c9-1f3f-41b3-af99-1631ad0710f7] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:14:11.489609 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-0a35cbda-0a0e-4185-9a8c-a498ee28fa94 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:11.490061 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-0a35cbda-0a0e-4185-9a8c-a498ee28fa94 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:11.490831 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-0a35cbda-0a0e-4185-9a8c-a498ee28fa94 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:11.491269 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-0a35cbda-0a0e-4185-9a8c-a498ee28fa94 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:11.644837 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-0a35cbda-0a0e-4185-9a8c-a498ee28fa94 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce4b25aa88412590502ccbc8ce0690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab20a59f54348e6b0d892ea010aff9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:14:11.652400 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-0a35cbda-0a0e-4185-9a8c-a498ee28fa94 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] 10.222.0.32 "GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7" status: 200 len: 1259 microversion: 2.1 time: 0.174543 May 30 12:14:11.652961 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 468/947] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:14:11 2022] GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7 => generated 1259 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:14:12.670761 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-5c893415-bf2a-4b88-bf3b-592abaf37381 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:14:12.671378 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-5c893415-bf2a-4b88-bf3b-592abaf37381 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] [instance: 030b59c9-1f3f-41b3-af99-1631ad0710f7] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:14:12.677935 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5c893415-bf2a-4b88-bf3b-592abaf37381 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:12.678387 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5c893415-bf2a-4b88-bf3b-592abaf37381 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:12.679153 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5c893415-bf2a-4b88-bf3b-592abaf37381 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:12.679590 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5c893415-bf2a-4b88-bf3b-592abaf37381 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:12.812952 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-5c893415-bf2a-4b88-bf3b-592abaf37381 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce4b25aa88412590502ccbc8ce0690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab20a59f54348e6b0d892ea010aff9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:14:12.820429 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-5c893415-bf2a-4b88-bf3b-592abaf37381 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] 10.222.0.32 "GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7" status: 200 len: 1259 microversion: 2.1 time: 0.154025 May 30 12:14:12.820995 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 480/948] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:14:12 2022] GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:14:13.836076 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-356b2ac2-1348-4d6b-87ae-0396642c4428 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:14:13.836721 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-356b2ac2-1348-4d6b-87ae-0396642c4428 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] [instance: 030b59c9-1f3f-41b3-af99-1631ad0710f7] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:14:13.839238 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell0:SELECT=2 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:13.845618 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-356b2ac2-1348-4d6b-87ae-0396642c4428 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:13.846072 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-356b2ac2-1348-4d6b-87ae-0396642c4428 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:13.846846 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-356b2ac2-1348-4d6b-87ae-0396642c4428 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:13.847287 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-356b2ac2-1348-4d6b-87ae-0396642c4428 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:14.028348 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-356b2ac2-1348-4d6b-87ae-0396642c4428 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce4b25aa88412590502ccbc8ce0690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab20a59f54348e6b0d892ea010aff9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:14:14.035889 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-356b2ac2-1348-4d6b-87ae-0396642c4428 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] 10.222.0.32 "GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7" status: 200 len: 1259 microversion: 2.1 time: 0.203710 May 30 12:14:14.036500 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 469/949] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:14:13 2022] GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7 => generated 1259 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:14:15.050063 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell0:SELECT=2 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:15.050845 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell0:SELECT=6 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:15.055430 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-f70bfa7f-be67-4db4-a479-bdf9508eb5e4 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:14:15.056047 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-f70bfa7f-be67-4db4-a479-bdf9508eb5e4 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] [instance: 030b59c9-1f3f-41b3-af99-1631ad0710f7] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:14:15.064200 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f70bfa7f-be67-4db4-a479-bdf9508eb5e4 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:15.064627 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f70bfa7f-be67-4db4-a479-bdf9508eb5e4 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:15.065430 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f70bfa7f-be67-4db4-a479-bdf9508eb5e4 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:15.066037 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f70bfa7f-be67-4db4-a479-bdf9508eb5e4 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:15.204391 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-f70bfa7f-be67-4db4-a479-bdf9508eb5e4 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce4b25aa88412590502ccbc8ce0690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab20a59f54348e6b0d892ea010aff9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:14:15.212073 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-f70bfa7f-be67-4db4-a479-bdf9508eb5e4 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] 10.222.0.32 "GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7" status: 200 len: 1259 microversion: 2.1 time: 0.162739 May 30 12:14:15.212663 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 481/950] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:14:15 2022] GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7 => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:14:16.228955 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-18468851-d40e-400c-9d29-f159c1e8706c tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:14:16.230173 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-18468851-d40e-400c-9d29-f159c1e8706c tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] [instance: 030b59c9-1f3f-41b3-af99-1631ad0710f7] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:14:16.236994 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-18468851-d40e-400c-9d29-f159c1e8706c tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:16.237433 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-18468851-d40e-400c-9d29-f159c1e8706c tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:16.238196 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-18468851-d40e-400c-9d29-f159c1e8706c tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:16.238625 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-18468851-d40e-400c-9d29-f159c1e8706c tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:16.374132 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-18468851-d40e-400c-9d29-f159c1e8706c tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce4b25aa88412590502ccbc8ce0690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab20a59f54348e6b0d892ea010aff9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:14:16.382050 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-18468851-d40e-400c-9d29-f159c1e8706c tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] 10.222.0.32 "GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7" status: 200 len: 1259 microversion: 2.1 time: 0.157038 May 30 12:14:16.382485 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 470/951] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:14:16 2022] GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:14:17.400373 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-94828784-1492-4cf0-9994-680db56dab6d tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:14:17.400990 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-94828784-1492-4cf0-9994-680db56dab6d tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] [instance: 030b59c9-1f3f-41b3-af99-1631ad0710f7] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:14:17.408178 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-94828784-1492-4cf0-9994-680db56dab6d tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:17.408639 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-94828784-1492-4cf0-9994-680db56dab6d tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:17.409413 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-94828784-1492-4cf0-9994-680db56dab6d tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:17.409852 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-94828784-1492-4cf0-9994-680db56dab6d tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:17.548029 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-94828784-1492-4cf0-9994-680db56dab6d tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce4b25aa88412590502ccbc8ce0690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab20a59f54348e6b0d892ea010aff9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:14:17.555442 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-94828784-1492-4cf0-9994-680db56dab6d tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] 10.222.0.32 "GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7" status: 200 len: 1259 microversion: 2.1 time: 0.159399 May 30 12:14:17.555997 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 482/952] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:14:17 2022] GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:14:18.352909 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-d4bcacf4-d1b6-487b-8d78-a5f7da03613f req-e8c6a762-b127-47ed-8824-f26ebbc712fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "030b59c9-1f3f-41b3-af99-1631ad0710f7", "name": "network-vif-plugged", "status": "completed", "tag": "36466e57-98c5-4029-b86f-9faa0fa79ccd"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:14:18.363399 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-d4bcacf4-d1b6-487b-8d78-a5f7da03613f req-e8c6a762-b127-47ed-8824-f26ebbc712fd service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:18.363851 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-d4bcacf4-d1b6-487b-8d78-a5f7da03613f req-e8c6a762-b127-47ed-8824-f26ebbc712fd service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:18.376470 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-d4bcacf4-d1b6-487b-8d78-a5f7da03613f req-e8c6a762-b127-47ed-8824-f26ebbc712fd service nova] Creating event network-vif-plugged:36466e57-98c5-4029-b86f-9faa0fa79ccd for instance 030b59c9-1f3f-41b3-af99-1631ad0710f7 on hv-cinder-84051 May 30 12:14:18.381520 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-d4bcacf4-d1b6-487b-8d78-a5f7da03613f req-e8c6a762-b127-47ed-8824-f26ebbc712fd service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032291 May 30 12:14:18.382122 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 471/953] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:14:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:14:18.572489 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-ffa73976-f0ed-4edf-b8ae-e32ec5443188 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:14:18.573019 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-ffa73976-f0ed-4edf-b8ae-e32ec5443188 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] [instance: 030b59c9-1f3f-41b3-af99-1631ad0710f7] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:14:18.580095 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ffa73976-f0ed-4edf-b8ae-e32ec5443188 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:18.580569 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ffa73976-f0ed-4edf-b8ae-e32ec5443188 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:18.581347 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ffa73976-f0ed-4edf-b8ae-e32ec5443188 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:18.581820 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ffa73976-f0ed-4edf-b8ae-e32ec5443188 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:18.716773 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-ffa73976-f0ed-4edf-b8ae-e32ec5443188 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce4b25aa88412590502ccbc8ce0690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab20a59f54348e6b0d892ea010aff9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:14:18.724238 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-ffa73976-f0ed-4edf-b8ae-e32ec5443188 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] 10.222.0.32 "GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7" status: 200 len: 1259 microversion: 2.1 time: 0.155868 May 30 12:14:18.724795 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 483/954] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:14:18 2022] GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:14:19.742669 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-21161062-5f30-4461-88e3-2b4e19b27503 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:14:19.743366 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-21161062-5f30-4461-88e3-2b4e19b27503 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] [instance: 030b59c9-1f3f-41b3-af99-1631ad0710f7] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:14:19.750088 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-21161062-5f30-4461-88e3-2b4e19b27503 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:19.750538 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-21161062-5f30-4461-88e3-2b4e19b27503 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:19.751300 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-21161062-5f30-4461-88e3-2b4e19b27503 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:19.751736 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-21161062-5f30-4461-88e3-2b4e19b27503 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:19.885670 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-21161062-5f30-4461-88e3-2b4e19b27503 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce4b25aa88412590502ccbc8ce0690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab20a59f54348e6b0d892ea010aff9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:14:19.893501 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-21161062-5f30-4461-88e3-2b4e19b27503 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] 10.222.0.32 "GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7" status: 200 len: 1444 microversion: 2.1 time: 0.155542 May 30 12:14:19.894075 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 472/955] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:14:19 2022] GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7 => generated 1444 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:14:19.909529 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-23738f53-2993-4d55-bda1-a2c44ce9f90a tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:14:19.910144 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-23738f53-2993-4d55-bda1-a2c44ce9f90a tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] [instance: 030b59c9-1f3f-41b3-af99-1631ad0710f7] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:14:19.916602 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-23738f53-2993-4d55-bda1-a2c44ce9f90a tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:19.917050 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-23738f53-2993-4d55-bda1-a2c44ce9f90a tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:19.917812 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-23738f53-2993-4d55-bda1-a2c44ce9f90a tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:19.918245 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-23738f53-2993-4d55-bda1-a2c44ce9f90a tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:20.049195 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-23738f53-2993-4d55-bda1-a2c44ce9f90a tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce4b25aa88412590502ccbc8ce0690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab20a59f54348e6b0d892ea010aff9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:14:20.057674 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-23738f53-2993-4d55-bda1-a2c44ce9f90a tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] 10.222.0.32 "GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7" status: 200 len: 1444 microversion: 2.1 time: 0.151725 May 30 12:14:20.058565 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 484/956] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:14:19 2022] GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7 => generated 1444 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:14:21.977344 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-be507292-5463-4aa1-b4e4-112cf6b1934f req-2bdc480f-70a5-4688-b5db-5d8331c410e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "030b59c9-1f3f-41b3-af99-1631ad0710f7", "tag": "36466e57-98c5-4029-b86f-9faa0fa79ccd"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:14:21.986958 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-be507292-5463-4aa1-b4e4-112cf6b1934f req-2bdc480f-70a5-4688-b5db-5d8331c410e6 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:21.987402 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-be507292-5463-4aa1-b4e4-112cf6b1934f req-2bdc480f-70a5-4688-b5db-5d8331c410e6 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:21.998526 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-be507292-5463-4aa1-b4e4-112cf6b1934f req-2bdc480f-70a5-4688-b5db-5d8331c410e6 service nova] Creating event network-changed:36466e57-98c5-4029-b86f-9faa0fa79ccd for instance 030b59c9-1f3f-41b3-af99-1631ad0710f7 on hv-cinder-84051 May 30 12:14:22.003922 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-be507292-5463-4aa1-b4e4-112cf6b1934f req-2bdc480f-70a5-4688-b5db-5d8331c410e6 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030335 May 30 12:14:22.004906 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 473/957] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:14:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:14:23.634148 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 30 12:14:23.634728 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Mon May 30 12:14:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 30 12:16:19.293693 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR oslo.messaging._drivers.impl_rabbit [-] [82e217f2-7696-4d16-93b0-9b8718b82e8d] AMQP server on 10.222.0.32:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 30 12:16:19.294309 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:19.295017 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell1:SELECT=56 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:19.299986 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-59b17ec0-1ea3-4020-b2ee-f1924cbf564c tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:16:19.300535 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-59b17ec0-1ea3-4020-b2ee-f1924cbf564c tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] [instance: 030b59c9-1f3f-41b3-af99-1631ad0710f7] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:16:19.308345 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-59b17ec0-1ea3-4020-b2ee-f1924cbf564c tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:19.308802 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-59b17ec0-1ea3-4020-b2ee-f1924cbf564c tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:19.309576 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-59b17ec0-1ea3-4020-b2ee-f1924cbf564c tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:19.310023 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-59b17ec0-1ea3-4020-b2ee-f1924cbf564c tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:19.332467 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.objects.instance [None req-59b17ec0-1ea3-4020-b2ee-f1924cbf564c tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lazy-loading 'flavor' on Instance uuid 030b59c9-1f3f-41b3-af99-1631ad0710f7 {{(pid=117671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 30 12:16:19.405505 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR oslo.messaging._drivers.impl_rabbit [None req-59b17ec0-1ea3-4020-b2ee-f1924cbf564c tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] [2c33b4bd-5135-40f5-847e-50cd9cf952dd] AMQP server on 10.222.0.32:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 30 12:16:20.302898 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO oslo.messaging._drivers.impl_rabbit [-] [82e217f2-7696-4d16-93b0-9b8718b82e8d] Reconnected to AMQP server on 10.222.0.32:5672 via [amqp] client with port 58396. May 30 12:16:20.413061 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO oslo.messaging._drivers.impl_rabbit [None req-59b17ec0-1ea3-4020-b2ee-f1924cbf564c tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] [2c33b4bd-5135-40f5-847e-50cd9cf952dd] Reconnected to AMQP server on 10.222.0.32:5672 via [amqp] client with port 58398. May 30 12:16:20.416524 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-59b17ec0-1ea3-4020-b2ee-f1924cbf564c tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] 10.222.0.32 "POST /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7/action" status: 202 len: 0 microversion: 2.1 time: 1.124921 May 30 12:16:20.417152 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 485/958] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 30 12:16:19 2022] POST /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7/action => generated 0 bytes in 1126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 30 12:16:20.423757 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_api:SELECT=22 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:20.425526 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell1:SELECT=42 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:20.430314 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-1269dbe2-fc25-4c26-8b8c-f0011194eaeb tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:16:20.431019 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-1269dbe2-fc25-4c26-8b8c-f0011194eaeb tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] [instance: 030b59c9-1f3f-41b3-af99-1631ad0710f7] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:16:20.443311 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1269dbe2-fc25-4c26-8b8c-f0011194eaeb tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:20.443779 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1269dbe2-fc25-4c26-8b8c-f0011194eaeb tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:20.444627 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1269dbe2-fc25-4c26-8b8c-f0011194eaeb tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:20.445081 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1269dbe2-fc25-4c26-8b8c-f0011194eaeb tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:20.581662 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-1269dbe2-fc25-4c26-8b8c-f0011194eaeb tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce4b25aa88412590502ccbc8ce0690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab20a59f54348e6b0d892ea010aff9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:16:20.589953 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-1269dbe2-fc25-4c26-8b8c-f0011194eaeb tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] 10.222.0.32 "GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7" status: 200 len: 1569 microversion: 2.1 time: 0.168051 May 30 12:16:20.590521 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 474/959] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:16:20 2022] GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7 => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:16:21.609017 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-065299bc-e07d-442f-91fc-600892efb8f6 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:16:21.609869 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-065299bc-e07d-442f-91fc-600892efb8f6 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] [instance: 030b59c9-1f3f-41b3-af99-1631ad0710f7] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:16:21.617187 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-065299bc-e07d-442f-91fc-600892efb8f6 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:21.617641 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-065299bc-e07d-442f-91fc-600892efb8f6 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:21.618507 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-065299bc-e07d-442f-91fc-600892efb8f6 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:21.619057 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-065299bc-e07d-442f-91fc-600892efb8f6 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:21.754985 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-065299bc-e07d-442f-91fc-600892efb8f6 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce4b25aa88412590502ccbc8ce0690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab20a59f54348e6b0d892ea010aff9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:16:21.762499 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-065299bc-e07d-442f-91fc-600892efb8f6 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] 10.222.0.32 "GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7" status: 200 len: 1569 microversion: 2.1 time: 0.158285 May 30 12:16:21.763054 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 486/960] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:16:21 2022] GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:16:22.779505 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-a88f31f9-d705-48b2-bb85-96feb952ec39 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:16:22.780124 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-a88f31f9-d705-48b2-bb85-96feb952ec39 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] [instance: 030b59c9-1f3f-41b3-af99-1631ad0710f7] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:16:22.786697 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a88f31f9-d705-48b2-bb85-96feb952ec39 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:22.787144 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a88f31f9-d705-48b2-bb85-96feb952ec39 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:22.787964 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a88f31f9-d705-48b2-bb85-96feb952ec39 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:22.788389 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a88f31f9-d705-48b2-bb85-96feb952ec39 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:22.918312 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-a88f31f9-d705-48b2-bb85-96feb952ec39 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce4b25aa88412590502ccbc8ce0690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab20a59f54348e6b0d892ea010aff9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:16:22.925833 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-a88f31f9-d705-48b2-bb85-96feb952ec39 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] 10.222.0.32 "GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7" status: 200 len: 1569 microversion: 2.1 time: 0.150215 May 30 12:16:22.926913 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 475/961] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:16:22 2022] GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:16:23.943600 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-8a9090e2-69ff-4989-b941-0e9686d1241e tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:16:23.944203 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-8a9090e2-69ff-4989-b941-0e9686d1241e tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] [instance: 030b59c9-1f3f-41b3-af99-1631ad0710f7] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:16:23.950831 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8a9090e2-69ff-4989-b941-0e9686d1241e tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:23.951279 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8a9090e2-69ff-4989-b941-0e9686d1241e tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:23.952049 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8a9090e2-69ff-4989-b941-0e9686d1241e tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:23.952513 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8a9090e2-69ff-4989-b941-0e9686d1241e tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:24.088305 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-8a9090e2-69ff-4989-b941-0e9686d1241e tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce4b25aa88412590502ccbc8ce0690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab20a59f54348e6b0d892ea010aff9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:16:24.095775 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-8a9090e2-69ff-4989-b941-0e9686d1241e tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] 10.222.0.32 "GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7" status: 200 len: 1569 microversion: 2.1 time: 0.156767 May 30 12:16:24.096359 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 487/962] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:16:23 2022] GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:16:25.113018 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-074a4063-7ecc-4a8b-9a8e-e9e38303f591 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:16:25.114193 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-074a4063-7ecc-4a8b-9a8e-e9e38303f591 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] [instance: 030b59c9-1f3f-41b3-af99-1631ad0710f7] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:16:25.120659 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-074a4063-7ecc-4a8b-9a8e-e9e38303f591 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:25.121105 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-074a4063-7ecc-4a8b-9a8e-e9e38303f591 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:25.121867 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-074a4063-7ecc-4a8b-9a8e-e9e38303f591 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:25.122304 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-074a4063-7ecc-4a8b-9a8e-e9e38303f591 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:25.253435 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-074a4063-7ecc-4a8b-9a8e-e9e38303f591 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce4b25aa88412590502ccbc8ce0690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab20a59f54348e6b0d892ea010aff9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:16:25.261643 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-074a4063-7ecc-4a8b-9a8e-e9e38303f591 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] 10.222.0.32 "GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7" status: 200 len: 1569 microversion: 2.1 time: 0.152533 May 30 12:16:25.262211 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 476/963] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:16:25 2022] GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:16:26.279178 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-d414a838-8a48-4a73-8452-643c87c70569 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:16:26.279801 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-d414a838-8a48-4a73-8452-643c87c70569 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] [instance: 030b59c9-1f3f-41b3-af99-1631ad0710f7] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:16:26.286474 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d414a838-8a48-4a73-8452-643c87c70569 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:26.286919 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d414a838-8a48-4a73-8452-643c87c70569 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:26.287689 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d414a838-8a48-4a73-8452-643c87c70569 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:26.288124 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d414a838-8a48-4a73-8452-643c87c70569 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:26.423170 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-d414a838-8a48-4a73-8452-643c87c70569 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce4b25aa88412590502ccbc8ce0690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab20a59f54348e6b0d892ea010aff9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:16:26.431403 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-d414a838-8a48-4a73-8452-643c87c70569 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] 10.222.0.32 "GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7" status: 200 len: 1569 microversion: 2.1 time: 0.156260 May 30 12:16:26.431970 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 488/964] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:16:26 2022] GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:16:27.449213 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-b33b9af5-caf8-406b-9369-7ffabbded1ea tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:16:27.450081 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-b33b9af5-caf8-406b-9369-7ffabbded1ea tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] [instance: 030b59c9-1f3f-41b3-af99-1631ad0710f7] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:16:27.456493 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b33b9af5-caf8-406b-9369-7ffabbded1ea tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:27.456936 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b33b9af5-caf8-406b-9369-7ffabbded1ea tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:27.458502 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b33b9af5-caf8-406b-9369-7ffabbded1ea tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:27.459453 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b33b9af5-caf8-406b-9369-7ffabbded1ea tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:27.624221 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-b33b9af5-caf8-406b-9369-7ffabbded1ea tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce4b25aa88412590502ccbc8ce0690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab20a59f54348e6b0d892ea010aff9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:16:27.632815 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-b33b9af5-caf8-406b-9369-7ffabbded1ea tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] 10.222.0.32 "GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7" status: 200 len: 1569 microversion: 2.1 time: 0.187618 May 30 12:16:27.633388 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 477/965] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:16:27 2022] GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7 => generated 1569 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:16:28.655336 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-3120b6ee-244b-45bf-b698-2548a40d411e tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:16:28.655951 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-3120b6ee-244b-45bf-b698-2548a40d411e tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] [instance: 030b59c9-1f3f-41b3-af99-1631ad0710f7] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:16:28.663106 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3120b6ee-244b-45bf-b698-2548a40d411e tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:28.663551 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3120b6ee-244b-45bf-b698-2548a40d411e tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:28.664351 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3120b6ee-244b-45bf-b698-2548a40d411e tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:28.664791 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3120b6ee-244b-45bf-b698-2548a40d411e tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:28.795987 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-3120b6ee-244b-45bf-b698-2548a40d411e tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce4b25aa88412590502ccbc8ce0690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab20a59f54348e6b0d892ea010aff9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:16:28.803999 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-3120b6ee-244b-45bf-b698-2548a40d411e tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] 10.222.0.32 "GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7" status: 200 len: 1569 microversion: 2.1 time: 0.152563 May 30 12:16:28.804588 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 489/966] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:16:28 2022] GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:16:29.821821 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-cde293b5-cbeb-4fcb-a419-d40c6ac5ba5e tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:16:29.822435 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-cde293b5-cbeb-4fcb-a419-d40c6ac5ba5e tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] [instance: 030b59c9-1f3f-41b3-af99-1631ad0710f7] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:16:29.828642 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-cde293b5-cbeb-4fcb-a419-d40c6ac5ba5e tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:29.829093 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-cde293b5-cbeb-4fcb-a419-d40c6ac5ba5e tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:29.829879 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-cde293b5-cbeb-4fcb-a419-d40c6ac5ba5e tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:29.830301 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-cde293b5-cbeb-4fcb-a419-d40c6ac5ba5e tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:29.968086 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-cde293b5-cbeb-4fcb-a419-d40c6ac5ba5e tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce4b25aa88412590502ccbc8ce0690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab20a59f54348e6b0d892ea010aff9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:16:29.976094 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-cde293b5-cbeb-4fcb-a419-d40c6ac5ba5e tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] 10.222.0.32 "GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7" status: 200 len: 1569 microversion: 2.1 time: 0.158295 May 30 12:16:29.976680 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 478/967] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:16:29 2022] GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:16:30.993246 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-6bef811d-db60-496a-b976-fab8b6ef4dba tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:16:30.993893 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-6bef811d-db60-496a-b976-fab8b6ef4dba tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] [instance: 030b59c9-1f3f-41b3-af99-1631ad0710f7] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:16:31.000776 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-6bef811d-db60-496a-b976-fab8b6ef4dba tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:31.001235 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-6bef811d-db60-496a-b976-fab8b6ef4dba tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:31.002013 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-6bef811d-db60-496a-b976-fab8b6ef4dba tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:31.002484 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-6bef811d-db60-496a-b976-fab8b6ef4dba tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:31.161132 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-6bef811d-db60-496a-b976-fab8b6ef4dba tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce4b25aa88412590502ccbc8ce0690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab20a59f54348e6b0d892ea010aff9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:16:31.168947 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-6bef811d-db60-496a-b976-fab8b6ef4dba tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] 10.222.0.32 "GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7" status: 200 len: 1569 microversion: 2.1 time: 0.179663 May 30 12:16:31.169553 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 490/968] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:16:30 2022] GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7 => generated 1569 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:16:32.186053 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-1378a0a7-5945-4a13-b20c-1a36744654c7 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:16:32.186660 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-1378a0a7-5945-4a13-b20c-1a36744654c7 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] [instance: 030b59c9-1f3f-41b3-af99-1631ad0710f7] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:16:32.193562 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1378a0a7-5945-4a13-b20c-1a36744654c7 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:32.194016 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1378a0a7-5945-4a13-b20c-1a36744654c7 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:32.194783 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1378a0a7-5945-4a13-b20c-1a36744654c7 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:32.195222 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1378a0a7-5945-4a13-b20c-1a36744654c7 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:32.329526 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-1378a0a7-5945-4a13-b20c-1a36744654c7 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce4b25aa88412590502ccbc8ce0690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab20a59f54348e6b0d892ea010aff9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:16:32.337449 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-1378a0a7-5945-4a13-b20c-1a36744654c7 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] 10.222.0.32 "GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7" status: 200 len: 1569 microversion: 2.1 time: 0.155214 May 30 12:16:32.338008 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 479/969] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:16:32 2022] GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:16:33.354741 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-0136c4fa-60d5-4704-be12-ca90b2ebe42e tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:16:33.355528 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-0136c4fa-60d5-4704-be12-ca90b2ebe42e tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] [instance: 030b59c9-1f3f-41b3-af99-1631ad0710f7] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:16:33.362221 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0136c4fa-60d5-4704-be12-ca90b2ebe42e tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:33.362666 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0136c4fa-60d5-4704-be12-ca90b2ebe42e tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:33.363427 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0136c4fa-60d5-4704-be12-ca90b2ebe42e tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:33.363857 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0136c4fa-60d5-4704-be12-ca90b2ebe42e tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:33.509213 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-0136c4fa-60d5-4704-be12-ca90b2ebe42e tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce4b25aa88412590502ccbc8ce0690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab20a59f54348e6b0d892ea010aff9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:16:33.516887 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-0136c4fa-60d5-4704-be12-ca90b2ebe42e tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] 10.222.0.32 "GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7" status: 200 len: 1569 microversion: 2.1 time: 0.166011 May 30 12:16:33.517453 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 491/970] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:16:33 2022] GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:16:34.534775 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-8583fb65-bd29-4ad9-a4d9-3b7597048274 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:16:34.535396 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-8583fb65-bd29-4ad9-a4d9-3b7597048274 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] [instance: 030b59c9-1f3f-41b3-af99-1631ad0710f7] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:16:34.542321 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8583fb65-bd29-4ad9-a4d9-3b7597048274 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:34.542770 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8583fb65-bd29-4ad9-a4d9-3b7597048274 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:34.543538 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8583fb65-bd29-4ad9-a4d9-3b7597048274 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:34.543978 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8583fb65-bd29-4ad9-a4d9-3b7597048274 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:34.675329 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-8583fb65-bd29-4ad9-a4d9-3b7597048274 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce4b25aa88412590502ccbc8ce0690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab20a59f54348e6b0d892ea010aff9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:16:34.683494 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-8583fb65-bd29-4ad9-a4d9-3b7597048274 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] 10.222.0.32 "GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7" status: 200 len: 1510 microversion: 2.1 time: 0.152598 May 30 12:16:34.684067 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 480/971] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:16:34 2022] GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7 => generated 1510 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:16:34.699705 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-5ec27702-0b56-4720-841d-dcc53618679f tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:16:34.700322 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-5ec27702-0b56-4720-841d-dcc53618679f tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] [instance: 030b59c9-1f3f-41b3-af99-1631ad0710f7] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:16:34.706872 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5ec27702-0b56-4720-841d-dcc53618679f tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:34.707319 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5ec27702-0b56-4720-841d-dcc53618679f tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:34.708082 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5ec27702-0b56-4720-841d-dcc53618679f tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:34.708553 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5ec27702-0b56-4720-841d-dcc53618679f tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:34.785247 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-5ec27702-0b56-4720-841d-dcc53618679f tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] 10.222.0.32 "POST /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7/action" status: 202 len: 0 microversion: 2.1 time: 0.089274 May 30 12:16:34.785730 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 492/972] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 30 12:16:34 2022] POST /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 30 12:16:34.794467 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-b364fb9c-f71d-4e7a-8e75-ff6de2ff77a5 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:16:34.795591 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-b364fb9c-f71d-4e7a-8e75-ff6de2ff77a5 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] [instance: 030b59c9-1f3f-41b3-af99-1631ad0710f7] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:16:34.801759 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b364fb9c-f71d-4e7a-8e75-ff6de2ff77a5 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:34.802221 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b364fb9c-f71d-4e7a-8e75-ff6de2ff77a5 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:34.803002 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b364fb9c-f71d-4e7a-8e75-ff6de2ff77a5 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:34.803586 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b364fb9c-f71d-4e7a-8e75-ff6de2ff77a5 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:34.944833 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-b364fb9c-f71d-4e7a-8e75-ff6de2ff77a5 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce4b25aa88412590502ccbc8ce0690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab20a59f54348e6b0d892ea010aff9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:16:34.952525 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-b364fb9c-f71d-4e7a-8e75-ff6de2ff77a5 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] 10.222.0.32 "GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7" status: 200 len: 1518 microversion: 2.1 time: 0.161793 May 30 12:16:34.953110 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 481/973] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:16:34 2022] GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7 => generated 1518 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:16:35.971556 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-2574bff8-ee20-43cc-82a8-33e1abd72085 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:16:35.972933 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-2574bff8-ee20-43cc-82a8-33e1abd72085 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] [instance: 030b59c9-1f3f-41b3-af99-1631ad0710f7] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:16:35.979974 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2574bff8-ee20-43cc-82a8-33e1abd72085 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:35.980479 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2574bff8-ee20-43cc-82a8-33e1abd72085 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:35.981252 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2574bff8-ee20-43cc-82a8-33e1abd72085 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:35.981686 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2574bff8-ee20-43cc-82a8-33e1abd72085 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:36.118868 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-2574bff8-ee20-43cc-82a8-33e1abd72085 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce4b25aa88412590502ccbc8ce0690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab20a59f54348e6b0d892ea010aff9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:16:36.126874 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-2574bff8-ee20-43cc-82a8-33e1abd72085 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] 10.222.0.32 "GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7" status: 200 len: 1520 microversion: 2.1 time: 0.159944 May 30 12:16:36.127454 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 493/974] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:16:35 2022] GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:16:36.941338 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-a4487913-9afe-497a-8caf-0d166ccc356e req-f7abaede-7d3b-482f-8ed9-dc0c199e1aaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "030b59c9-1f3f-41b3-af99-1631ad0710f7", "name": "network-vif-unplugged", "status": "completed", "tag": "36466e57-98c5-4029-b86f-9faa0fa79ccd"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:16:36.950649 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-a4487913-9afe-497a-8caf-0d166ccc356e req-f7abaede-7d3b-482f-8ed9-dc0c199e1aaa service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:36.950921 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-a4487913-9afe-497a-8caf-0d166ccc356e req-f7abaede-7d3b-482f-8ed9-dc0c199e1aaa service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:36.973881 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-a4487913-9afe-497a-8caf-0d166ccc356e req-f7abaede-7d3b-482f-8ed9-dc0c199e1aaa service nova] Creating event network-vif-unplugged:36466e57-98c5-4029-b86f-9faa0fa79ccd for instance 030b59c9-1f3f-41b3-af99-1631ad0710f7 on hv-cinder-84051 May 30 12:16:36.980649 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-a4487913-9afe-497a-8caf-0d166ccc356e req-f7abaede-7d3b-482f-8ed9-dc0c199e1aaa service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.110731 May 30 12:16:36.981350 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 482/975] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:16:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:16:37.145365 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-735816b2-1bcf-4432-aa2a-131474e1da88 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:16:37.146035 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-735816b2-1bcf-4432-aa2a-131474e1da88 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] [instance: 030b59c9-1f3f-41b3-af99-1631ad0710f7] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:16:37.153644 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-735816b2-1bcf-4432-aa2a-131474e1da88 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:37.154157 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-735816b2-1bcf-4432-aa2a-131474e1da88 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:37.154897 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-735816b2-1bcf-4432-aa2a-131474e1da88 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:37.155339 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-735816b2-1bcf-4432-aa2a-131474e1da88 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:37.287934 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-735816b2-1bcf-4432-aa2a-131474e1da88 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce4b25aa88412590502ccbc8ce0690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab20a59f54348e6b0d892ea010aff9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:16:37.296185 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-735816b2-1bcf-4432-aa2a-131474e1da88 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] 10.222.0.32 "GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7" status: 200 len: 1576 microversion: 2.1 time: 0.154656 May 30 12:16:37.296762 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 494/976] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:16:37 2022] GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:16:38.313846 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-d9d8a09e-df92-4818-b842-435be7205108 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:16:38.314540 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-d9d8a09e-df92-4818-b842-435be7205108 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] [instance: 030b59c9-1f3f-41b3-af99-1631ad0710f7] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:16:38.321406 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d9d8a09e-df92-4818-b842-435be7205108 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:38.321851 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d9d8a09e-df92-4818-b842-435be7205108 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:38.322618 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d9d8a09e-df92-4818-b842-435be7205108 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:38.323055 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d9d8a09e-df92-4818-b842-435be7205108 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:38.459388 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-d9d8a09e-df92-4818-b842-435be7205108 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce4b25aa88412590502ccbc8ce0690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab20a59f54348e6b0d892ea010aff9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:16:38.467396 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-d9d8a09e-df92-4818-b842-435be7205108 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] 10.222.0.32 "GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7" status: 200 len: 1576 microversion: 2.1 time: 0.157736 May 30 12:16:38.467948 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 483/977] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:16:38 2022] GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:16:39.484230 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-8c880a8b-73ac-4987-b815-6532058088f6 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:16:39.484826 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-8c880a8b-73ac-4987-b815-6532058088f6 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] [instance: 030b59c9-1f3f-41b3-af99-1631ad0710f7] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:16:39.491396 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8c880a8b-73ac-4987-b815-6532058088f6 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:39.491840 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8c880a8b-73ac-4987-b815-6532058088f6 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:39.493188 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8c880a8b-73ac-4987-b815-6532058088f6 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:39.493819 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8c880a8b-73ac-4987-b815-6532058088f6 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:39.627910 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-8c880a8b-73ac-4987-b815-6532058088f6 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce4b25aa88412590502ccbc8ce0690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab20a59f54348e6b0d892ea010aff9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:16:39.636403 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-8c880a8b-73ac-4987-b815-6532058088f6 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] 10.222.0.32 "GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7" status: 200 len: 1576 microversion: 2.1 time: 0.156047 May 30 12:16:39.636971 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 495/978] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:16:39 2022] GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:16:40.654464 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-7d217173-c98f-4b15-ad10-7fcbf80a8405 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:16:40.655073 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-7d217173-c98f-4b15-ad10-7fcbf80a8405 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] [instance: 030b59c9-1f3f-41b3-af99-1631ad0710f7] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:16:40.661565 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7d217173-c98f-4b15-ad10-7fcbf80a8405 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:40.662012 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7d217173-c98f-4b15-ad10-7fcbf80a8405 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:40.662767 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7d217173-c98f-4b15-ad10-7fcbf80a8405 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:40.663205 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7d217173-c98f-4b15-ad10-7fcbf80a8405 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:40.794050 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-7d217173-c98f-4b15-ad10-7fcbf80a8405 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce4b25aa88412590502ccbc8ce0690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab20a59f54348e6b0d892ea010aff9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:16:40.801660 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-7d217173-c98f-4b15-ad10-7fcbf80a8405 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] 10.222.0.32 "GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7" status: 200 len: 1576 microversion: 2.1 time: 0.151048 May 30 12:16:40.802231 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 484/979] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:16:40 2022] GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7 => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:16:41.818919 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-0544e993-c816-44a4-b64f-71cd47a0c4a9 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:16:41.819557 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-0544e993-c816-44a4-b64f-71cd47a0c4a9 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] [instance: 030b59c9-1f3f-41b3-af99-1631ad0710f7] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:16:41.826291 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0544e993-c816-44a4-b64f-71cd47a0c4a9 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:41.826737 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0544e993-c816-44a4-b64f-71cd47a0c4a9 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:41.827495 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0544e993-c816-44a4-b64f-71cd47a0c4a9 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:41.827923 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0544e993-c816-44a4-b64f-71cd47a0c4a9 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:41.959802 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-0544e993-c816-44a4-b64f-71cd47a0c4a9 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce4b25aa88412590502ccbc8ce0690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab20a59f54348e6b0d892ea010aff9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:16:41.967393 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-0544e993-c816-44a4-b64f-71cd47a0c4a9 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] 10.222.0.32 "GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7" status: 200 len: 1576 microversion: 2.1 time: 0.152387 May 30 12:16:41.967956 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 496/980] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:16:41 2022] GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:16:42.984285 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-05e90875-4cb4-4027-8a06-ef4c48216e5f tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:16:42.984837 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-05e90875-4cb4-4027-8a06-ef4c48216e5f tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] [instance: 030b59c9-1f3f-41b3-af99-1631ad0710f7] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:16:42.991389 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-05e90875-4cb4-4027-8a06-ef4c48216e5f tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:42.991842 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-05e90875-4cb4-4027-8a06-ef4c48216e5f tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:42.992730 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-05e90875-4cb4-4027-8a06-ef4c48216e5f tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:42.993303 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-05e90875-4cb4-4027-8a06-ef4c48216e5f tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:43.128683 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-05e90875-4cb4-4027-8a06-ef4c48216e5f tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce4b25aa88412590502ccbc8ce0690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab20a59f54348e6b0d892ea010aff9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:16:43.136675 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-05e90875-4cb4-4027-8a06-ef4c48216e5f tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] 10.222.0.32 "GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7" status: 200 len: 1576 microversion: 2.1 time: 0.156463 May 30 12:16:43.137240 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 485/981] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:16:42 2022] GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:16:44.155370 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-91205e44-56bf-40d4-86ff-9ddfbd399b75 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:16:44.155960 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-91205e44-56bf-40d4-86ff-9ddfbd399b75 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] [instance: 030b59c9-1f3f-41b3-af99-1631ad0710f7] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:16:44.162507 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-91205e44-56bf-40d4-86ff-9ddfbd399b75 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:44.162947 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-91205e44-56bf-40d4-86ff-9ddfbd399b75 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:44.163701 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-91205e44-56bf-40d4-86ff-9ddfbd399b75 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:44.164134 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-91205e44-56bf-40d4-86ff-9ddfbd399b75 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:44.302600 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-91205e44-56bf-40d4-86ff-9ddfbd399b75 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce4b25aa88412590502ccbc8ce0690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab20a59f54348e6b0d892ea010aff9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:16:44.310437 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-91205e44-56bf-40d4-86ff-9ddfbd399b75 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] 10.222.0.32 "GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7" status: 200 len: 1576 microversion: 2.1 time: 0.158930 May 30 12:16:44.311032 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 497/982] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:16:44 2022] GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:16:45.328544 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-7008676b-bc84-465a-9daa-a312a92e0433 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:16:45.329165 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-7008676b-bc84-465a-9daa-a312a92e0433 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] [instance: 030b59c9-1f3f-41b3-af99-1631ad0710f7] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:16:45.335183 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7008676b-bc84-465a-9daa-a312a92e0433 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:45.335635 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7008676b-bc84-465a-9daa-a312a92e0433 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:45.336563 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7008676b-bc84-465a-9daa-a312a92e0433 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:45.337158 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7008676b-bc84-465a-9daa-a312a92e0433 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:45.476450 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-7008676b-bc84-465a-9daa-a312a92e0433 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce4b25aa88412590502ccbc8ce0690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab20a59f54348e6b0d892ea010aff9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:16:45.484437 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-7008676b-bc84-465a-9daa-a312a92e0433 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] 10.222.0.32 "GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7" status: 200 len: 1563 microversion: 2.1 time: 0.161119 May 30 12:16:45.484977 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 486/983] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:16:45 2022] GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7 => generated 1563 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:16:46.937634 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-df9f820a-174e-4cdf-b1a3-6daac8708c67 req-21d0b610-c09c-45f0-ac24-263a1a25b464 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "030b59c9-1f3f-41b3-af99-1631ad0710f7", "name": "network-vif-plugged", "status": "completed", "tag": "36466e57-98c5-4029-b86f-9faa0fa79ccd"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:16:46.946714 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-df9f820a-174e-4cdf-b1a3-6daac8708c67 req-21d0b610-c09c-45f0-ac24-263a1a25b464 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:46.947456 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-df9f820a-174e-4cdf-b1a3-6daac8708c67 req-21d0b610-c09c-45f0-ac24-263a1a25b464 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:46.960823 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-df9f820a-174e-4cdf-b1a3-6daac8708c67 req-21d0b610-c09c-45f0-ac24-263a1a25b464 service nova] Creating event network-vif-plugged:36466e57-98c5-4029-b86f-9faa0fa79ccd for instance 030b59c9-1f3f-41b3-af99-1631ad0710f7 on hv-cinder-84051 May 30 12:16:46.966349 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-df9f820a-174e-4cdf-b1a3-6daac8708c67 req-21d0b610-c09c-45f0-ac24-263a1a25b464 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032431 May 30 12:16:46.966917 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 498/984] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:16:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 30 12:17:43.642931 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 30 12:17:43.643568 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Mon May 30 12:17:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 30 12:18:01.647319 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a7a082e1-c3c0-4ddb-81e3-672e5371c0f7] AMQP server on 10.222.0.32:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 30 12:18:01.647929 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_api:SELECT=26 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:18:01.648971 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell1:SELECT=74 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:18:01.651886 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_api:SELECT=30 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:18:01.652782 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:18:01.657310 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-4a62a3a8-42d6-4dd8-bb2a-e948c2911215 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:18:01.657815 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-4a62a3a8-42d6-4dd8-bb2a-e948c2911215 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] [instance: 030b59c9-1f3f-41b3-af99-1631ad0710f7] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:18:01.664842 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4a62a3a8-42d6-4dd8-bb2a-e948c2911215 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:18:01.671724 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4a62a3a8-42d6-4dd8-bb2a-e948c2911215 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:18:01.672976 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4a62a3a8-42d6-4dd8-bb2a-e948c2911215 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:18:01.673685 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4a62a3a8-42d6-4dd8-bb2a-e948c2911215 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:18:01.704311 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-4a62a3a8-42d6-4dd8-bb2a-e948c2911215 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] [instance: 030b59c9-1f3f-41b3-af99-1631ad0710f7] Going to try to terminate instance {{(pid=117670) delete /opt/stack/nova/nova/compute/api.py:2664}} May 30 12:18:01.753155 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-c2c56c6e-809c-47ce-bfeb-553ff8137953 req-de4283bf-66d8-4734-b303-33b7d202812a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "030b59c9-1f3f-41b3-af99-1631ad0710f7", "tag": "36466e57-98c5-4029-b86f-9faa0fa79ccd"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:18:01.761874 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-c2c56c6e-809c-47ce-bfeb-553ff8137953 req-de4283bf-66d8-4734-b303-33b7d202812a service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:18:01.762448 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-c2c56c6e-809c-47ce-bfeb-553ff8137953 req-de4283bf-66d8-4734-b303-33b7d202812a service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:18:01.774338 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-c2c56c6e-809c-47ce-bfeb-553ff8137953 req-de4283bf-66d8-4734-b303-33b7d202812a service nova] Creating event network-changed:36466e57-98c5-4029-b86f-9faa0fa79ccd for instance 030b59c9-1f3f-41b3-af99-1631ad0710f7 on hv-cinder-84051 May 30 12:18:01.780213 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-c2c56c6e-809c-47ce-bfeb-553ff8137953 req-de4283bf-66d8-4734-b303-33b7d202812a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133629 May 30 12:18:01.780810 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 499/985] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:18:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:18:01.792812 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-4a62a3a8-42d6-4dd8-bb2a-e948c2911215 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] 10.222.0.32 "DELETE /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7" status: 204 len: 0 microversion: 2.1 time: 0.148987 May 30 12:18:01.793577 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 487/986] 10.222.0.32 () {58 vars in 1238 bytes} [Mon May 30 12:18:01 2022] DELETE /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 30 12:18:01.802837 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-1a5e892b-ba1e-4ae0-920c-43a7d604f2ac tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:18:01.803634 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-1a5e892b-ba1e-4ae0-920c-43a7d604f2ac tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] [instance: 030b59c9-1f3f-41b3-af99-1631ad0710f7] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:18:01.810305 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1a5e892b-ba1e-4ae0-920c-43a7d604f2ac tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:18:01.810838 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1a5e892b-ba1e-4ae0-920c-43a7d604f2ac tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:18:01.811681 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1a5e892b-ba1e-4ae0-920c-43a7d604f2ac tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:18:01.812216 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1a5e892b-ba1e-4ae0-920c-43a7d604f2ac tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:18:01.950468 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-1a5e892b-ba1e-4ae0-920c-43a7d604f2ac tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce4b25aa88412590502ccbc8ce0690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab20a59f54348e6b0d892ea010aff9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:18:01.958097 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-1a5e892b-ba1e-4ae0-920c-43a7d604f2ac tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] 10.222.0.32 "GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7" status: 200 len: 1569 microversion: 2.1 time: 0.159542 May 30 12:18:01.958881 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 500/987] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:18:01 2022] GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:18:02.976650 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-763f136c-18db-473b-acf2-e715a47e6fa2 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:18:02.977260 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-763f136c-18db-473b-acf2-e715a47e6fa2 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] [instance: 030b59c9-1f3f-41b3-af99-1631ad0710f7] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:18:02.985600 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-763f136c-18db-473b-acf2-e715a47e6fa2 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:18:02.986044 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-763f136c-18db-473b-acf2-e715a47e6fa2 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:18:02.986839 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-763f136c-18db-473b-acf2-e715a47e6fa2 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:18:02.987269 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-763f136c-18db-473b-acf2-e715a47e6fa2 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:18:03.007112 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO oslo.messaging._drivers.impl_rabbit [-] [a7a082e1-c3c0-4ddb-81e3-672e5371c0f7] Reconnected to AMQP server on 10.222.0.32:5672 via [amqp] client with port 58502. May 30 12:18:03.128818 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-763f136c-18db-473b-acf2-e715a47e6fa2 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce4b25aa88412590502ccbc8ce0690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab20a59f54348e6b0d892ea010aff9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:18:03.137763 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-763f136c-18db-473b-acf2-e715a47e6fa2 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] 10.222.0.32 "GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7" status: 200 len: 1569 microversion: 2.1 time: 0.165375 May 30 12:18:03.138680 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 488/988] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:18:02 2022] GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:18:04.160545 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-0b00c2ac-806f-4d26-8367-a38c9041a222 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:18:04.161159 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-0b00c2ac-806f-4d26-8367-a38c9041a222 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] [instance: 030b59c9-1f3f-41b3-af99-1631ad0710f7] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:18:04.172005 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-0b00c2ac-806f-4d26-8367-a38c9041a222 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:18:04.172496 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-0b00c2ac-806f-4d26-8367-a38c9041a222 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:18:04.173435 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-0b00c2ac-806f-4d26-8367-a38c9041a222 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:18:04.174447 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-0b00c2ac-806f-4d26-8367-a38c9041a222 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:18:04.238879 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-a351fa20-2d0d-4651-bc28-e5437eddd25e req-30daf9bc-9da4-457b-831c-a1086c6383e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "030b59c9-1f3f-41b3-af99-1631ad0710f7", "name": "network-vif-deleted", "tag": "36466e57-98c5-4029-b86f-9faa0fa79ccd"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:18:04.244941 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-0b00c2ac-806f-4d26-8367-a38c9041a222 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fce4b25aa88412590502ccbc8ce0690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab20a59f54348e6b0d892ea010aff9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:18:04.248615 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-a351fa20-2d0d-4651-bc28-e5437eddd25e req-30daf9bc-9da4-457b-831c-a1086c6383e3 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:18:04.248790 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-a351fa20-2d0d-4651-bc28-e5437eddd25e req-30daf9bc-9da4-457b-831c-a1086c6383e3 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:18:04.253223 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-0b00c2ac-806f-4d26-8367-a38c9041a222 tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] 10.222.0.32 "GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7" status: 200 len: 1383 microversion: 2.1 time: 0.097483 May 30 12:18:04.253800 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 489/989] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:18:04 2022] GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7 => generated 1383 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:18:04.261785 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-a351fa20-2d0d-4651-bc28-e5437eddd25e req-30daf9bc-9da4-457b-831c-a1086c6383e3 service nova] Creating event network-vif-deleted:36466e57-98c5-4029-b86f-9faa0fa79ccd for instance 030b59c9-1f3f-41b3-af99-1631ad0710f7 on hv-cinder-84051 May 30 12:18:04.267492 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-a351fa20-2d0d-4651-bc28-e5437eddd25e req-30daf9bc-9da4-457b-831c-a1086c6383e3 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115369 May 30 12:18:04.268096 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 501/990] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:18:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:18:05.270676 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-6f406a08-d5bf-43ed-9ef5-48c2a43fcf2f tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:18:05.271232 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-6f406a08-d5bf-43ed-9ef5-48c2a43fcf2f tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] [instance: 030b59c9-1f3f-41b3-af99-1631ad0710f7] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:18:05.278040 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6f406a08-d5bf-43ed-9ef5-48c2a43fcf2f tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:18:05.278501 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6f406a08-d5bf-43ed-9ef5-48c2a43fcf2f tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:18:05.279867 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6f406a08-d5bf-43ed-9ef5-48c2a43fcf2f tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:18:05.280417 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6f406a08-d5bf-43ed-9ef5-48c2a43fcf2f tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:18:05.294065 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.wsgi [None req-6f406a08-d5bf-43ed-9ef5-48c2a43fcf2f tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] HTTP exception thrown: Instance 030b59c9-1f3f-41b3-af99-1631ad0710f7 could not be found. May 30 12:18:05.296624 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-6f406a08-d5bf-43ed-9ef5-48c2a43fcf2f tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Request method failure captured: May 30 12:18:05.296624 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: request: GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7 HTTP/1.1 May 30 12:18:05.296624 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Accept: application/json May 30 12:18:05.296624 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Accept-Encoding: identity May 30 12:18:05.296624 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Connection: close May 30 12:18:05.296624 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Content-Length: 0 May 30 12:18:05.296624 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Content-Type: application/json May 30 12:18:05.296624 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Host: 10.222.0.32 May 30 12:18:05.296624 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Openstack-System-Scope: None May 30 12:18:05.296624 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: User-Agent: python-urllib3/1.26.9 May 30 12:18:05.296624 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Auth-Token: gAAAAABilLTyHRIolU5-mt0ucqUoudh0DZWEHzEqZfd3d7ZKdPSeJVBd--bfMGWVuhb4vBaHA2VEoC3_UulHM27YoDbsTspITDUZB9AdQQjMM43V8pcJ0x-2gFDEpMQyvLilKOVV3Pw-QlxOy85Hkf-h1yG-PHJcnyAZk-CHvE2Pb4ACiIcgqN0 May 30 12:18:05.296624 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Domain-Id: None May 30 12:18:05.296624 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Domain-Name: None May 30 12:18:05.296624 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Identity-Status: Confirmed May 30 12:18:05.296624 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Is-Admin-Project: True May 30 12:18:05.296624 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Domain-Id: default May 30 12:18:05.296624 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Domain-Name: Default May 30 12:18:05.296624 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Id: 7ab20a59f54348e6b0d892ea010aff9c May 30 12:18:05.296624 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Name: tempest-TestShelveInstance-663614298 May 30 12:18:05.296624 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Role: reader,member May 30 12:18:05.296624 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Roles: reader,member May 30 12:18:05.298382 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/7ab20a59f54348e6b0d892ea010aff9c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/7ab20a59f54348e6b0d892ea010aff9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/7ab20a59f54348e6b0d892ea010aff9c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_7ab20a59f54348e6b0d892ea010aff9c", "adminURL": "http://10.222.0.32:8080"}]}] May 30 12:18:05.298382 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant: tempest-TestShelveInstance-663614298 May 30 12:18:05.298382 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant-Id: 7ab20a59f54348e6b0d892ea010aff9c May 30 12:18:05.298382 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant-Name: tempest-TestShelveInstance-663614298 May 30 12:18:05.298382 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User: tempest-TestShelveInstance-663614298-project May 30 12:18:05.298382 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Domain-Id: default May 30 12:18:05.298382 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Domain-Name: Default May 30 12:18:05.298382 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Id: 7fce4b25aa88412590502ccbc8ce0690 May 30 12:18:05.298382 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Name: tempest-TestShelveInstance-663614298-project May 30 12:18:05.298382 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: method: > May 30 12:18:05.298382 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: exception: Instance 030b59c9-1f3f-41b3-af99-1631ad0710f7 could not be found. May 30 12:18:05.298382 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: action_args: {'id': '030b59c9-1f3f-41b3-af99-1631ad0710f7'} May 30 12:18:05.299448 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:18:05.299448 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:18:05.299448 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:18:05.299448 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:18:05.299448 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:18:05.299448 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:18:05.299448 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:18:05.299448 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:18:05.299448 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:18:05.299448 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:18:05.299448 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 030b59c9-1f3f-41b3-af99-1631ad0710f7 could not be found. May 30 12:18:05.299448 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:18:05.299448 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:18:05.299448 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:18:05.299448 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:18:05.299448 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:18:05.299448 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:18:05.299448 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:18:05.299448 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:18:05.299448 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:18:05.301082 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:18:05.301082 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 30 12:18:05.301082 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 30 12:18:05.301082 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 30 12:18:05.301082 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 30 12:18:05.301082 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:18:05.301082 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:18:05.301082 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 030b59c9-1f3f-41b3-af99-1631ad0710f7 could not be found. May 30 12:18:05.301082 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:18:05.301082 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:18:05.301082 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:18:05.301082 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:18:05.301082 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:18:05.301082 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:18:05.301082 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:18:05.301082 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:18:05.301082 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 030b59c9-1f3f-41b3-af99-1631ad0710f7 could not be found. May 30 12:18:05.301082 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:18:05.302526 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-6f406a08-d5bf-43ed-9ef5-48c2a43fcf2f tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Returning 404 to user: Instance 030b59c9-1f3f-41b3-af99-1631ad0710f7 could not be found. {{(pid=117670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:18:05.302526 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-6f406a08-d5bf-43ed-9ef5-48c2a43fcf2f tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] 10.222.0.32 "GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7" status: 404 len: 111 microversion: 2.1 time: 0.031429 May 30 12:18:05.302526 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 490/991] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:18:05 2022] GET /compute/v2.1/servers/030b59c9-1f3f-41b3-af99-1631ad0710f7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 30 12:18:05.458545 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-6b010bfd-6fa7-4df8-82ae-a820aae47ddf tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] Calling method '.version_select at 0x7f0ef891f940>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:18:05.478502 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-6b010bfd-6fa7-4df8-82ae-a820aae47ddf tempest-TestShelveInstance-663614298 tempest-TestShelveInstance-663614298-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1163141210" status: 202 len: 0 microversion: 2.1 time: 0.024588 May 30 12:18:05.479085 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 502/992] 10.222.0.32 () {58 vars in 1253 bytes} [Mon May 30 12:18:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1163141210 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 30 12:18:22.901137 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:18:22.902309 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:18:23.082842 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-9d740f02-90b4-4024-8f24-a167b16accc6 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Action: 'create', calling method: .version_select at 0x7f0ef8640ca0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1330641870", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLOW9ueSR5/FJqt2xBziQiNe698OZdXXqYJ9Ts+om4FlSnMNREAK9y1+9kjj5IzQNZRPITC+JeIAmjSsiyxpM/vQm2Iw3GDECYAlqMkc9K8xx0y5QakKFZIazqAeHftApA=="}} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:18:23.097374 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.quota [None req-9d740f02-90b4-4024-8f24-a167b16accc6 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Getting quotas for project 5143c400e4544c79955f901394c449f6. Resources: {'key_pairs'} {{(pid=117670) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 30 12:18:23.101186 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.quota [None req-9d740f02-90b4-4024-8f24-a167b16accc6 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Getting quotas for user 923af8dc0f1d4779bf388151093311f6 and project 5143c400e4544c79955f901394c449f6. Resources: {'key_pairs'} {{(pid=117670) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 30 12:18:23.125713 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-9d740f02-90b4-4024-8f24-a167b16accc6 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.229739 May 30 12:18:23.126396 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 491/993] 10.222.0.32 () {60 vars in 1158 bytes} [Mon May 30 12:18:22 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:18:41.548399 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell1:SELECT=10 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:18:41.549137 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:18:41.553109 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-e1ae90b8-df73-4367-89d2-44f971d2df10 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-371570614", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1330641870", "security_groups": [{"name": "tempest-secgroup-smoke-2037472610"}], "block_device_mapping_v2": [{"uuid": "e0ee822b-25b8-4e94-99b5-6f43dcb9b536", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "912f6667-0e8d-45c3-8e3f-950b457426b6"}]}} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:18:41.666603 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.network.neutron [None req-e1ae90b8-df73-4367-89d2-44f971d2df10 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] validate_networks() for [('912f6667-0e8d-45c3-8e3f-950b457426b6', None, None, None, None, None)] {{(pid=117671) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 30 12:18:42.040617 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-e1ae90b8-df73-4367-89d2-44f971d2df10 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Flavor limits 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 30 12:18:42.041044 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-e1ae90b8-df73-4367-89d2-44f971d2df10 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Image limits 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 30 12:18:42.041552 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-e1ae90b8-df73-4367-89d2-44f971d2df10 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Flavor pref 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 30 12:18:42.041964 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-e1ae90b8-df73-4367-89d2-44f971d2df10 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Image pref 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 30 12:18:42.042378 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-e1ae90b8-df73-4367-89d2-44f971d2df10 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 30 12:18:42.051570 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e1ae90b8-df73-4367-89d2-44f971d2df10 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:18:42.052022 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e1ae90b8-df73-4367-89d2-44f971d2df10 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:18:42.052937 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e1ae90b8-df73-4367-89d2-44f971d2df10 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:18:42.053377 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e1ae90b8-df73-4367-89d2-44f971d2df10 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:18:42.070446 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.quota [None req-e1ae90b8-df73-4367-89d2-44f971d2df10 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Getting quotas for project 5143c400e4544c79955f901394c449f6. Resources: {'cores', 'instances', 'ram'} {{(pid=117671) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 30 12:18:42.074402 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.quota [None req-e1ae90b8-df73-4367-89d2-44f971d2df10 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Getting quotas for user 923af8dc0f1d4779bf388151093311f6 and project 5143c400e4544c79955f901394c449f6. Resources: {'cores', 'instances', 'ram'} {{(pid=117671) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 30 12:18:42.131818 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-e1ae90b8-df73-4367-89d2-44f971d2df10 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Going to run 1 instances... {{(pid=117671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 30 12:18:42.134108 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-e1ae90b8-df73-4367-89d2-44f971d2df10 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] [instance: 0a940b67-afa3-4dbd-b665-bff213c051c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e0ee822b-25b8-4e94-99b5-6f43dcb9b536',volume_size=None,volume_type=None)] {{(pid=117671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 30 12:18:42.263008 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-e1ae90b8-df73-4367-89d2-44f971d2df10 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.715313 May 30 12:18:42.263710 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 503/994] 10.222.0.32 () {60 vars in 1146 bytes} [Mon May 30 12:18:41 2022] POST /compute/v2.1/servers => generated 406 bytes in 717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 30 12:18:42.271191 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell0:SELECT=4 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:18:42.271941 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:18:42.276614 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-93c5841e-650a-453b-8c4c-7984426c1130 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:18:42.277230 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-93c5841e-650a-453b-8c4c-7984426c1130 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] [instance: 0a940b67-afa3-4dbd-b665-bff213c051c3] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:18:42.333013 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-93c5841e-650a-453b-8c4c-7984426c1130 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923af8dc0f1d4779bf388151093311f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143c400e4544c79955f901394c449f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:18:42.339682 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-93c5841e-650a-453b-8c4c-7984426c1130 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] 10.222.0.32 "GET /compute/v2.1/servers/0a940b67-afa3-4dbd-b665-bff213c051c3" status: 200 len: 1094 microversion: 2.1 time: 0.069834 May 30 12:18:42.340270 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 492/995] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:18:42 2022] GET /compute/v2.1/servers/0a940b67-afa3-4dbd-b665-bff213c051c3 => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:18:43.360062 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-db53315b-1bd0-4e06-8f4b-687ab5bc0dcb tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:18:43.361196 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-db53315b-1bd0-4e06-8f4b-687ab5bc0dcb tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] [instance: 0a940b67-afa3-4dbd-b665-bff213c051c3] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:18:43.416127 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-db53315b-1bd0-4e06-8f4b-687ab5bc0dcb tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923af8dc0f1d4779bf388151093311f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143c400e4544c79955f901394c449f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:18:43.423635 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-db53315b-1bd0-4e06-8f4b-687ab5bc0dcb tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] 10.222.0.32 "GET /compute/v2.1/servers/0a940b67-afa3-4dbd-b665-bff213c051c3" status: 200 len: 1094 microversion: 2.1 time: 0.070927 May 30 12:18:43.424216 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 504/996] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:18:43 2022] GET /compute/v2.1/servers/0a940b67-afa3-4dbd-b665-bff213c051c3 => generated 1094 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:18:44.441573 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-328cf9e0-2464-446e-bc1c-d4700ab27dca tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:18:44.442303 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-328cf9e0-2464-446e-bc1c-d4700ab27dca tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] [instance: 0a940b67-afa3-4dbd-b665-bff213c051c3] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:18:44.504313 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-328cf9e0-2464-446e-bc1c-d4700ab27dca tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923af8dc0f1d4779bf388151093311f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143c400e4544c79955f901394c449f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:18:44.511055 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-328cf9e0-2464-446e-bc1c-d4700ab27dca tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] 10.222.0.32 "GET /compute/v2.1/servers/0a940b67-afa3-4dbd-b665-bff213c051c3" status: 200 len: 1094 microversion: 2.1 time: 0.074097 May 30 12:18:44.511621 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 493/997] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:18:44 2022] GET /compute/v2.1/servers/0a940b67-afa3-4dbd-b665-bff213c051c3 => generated 1094 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:18:45.531800 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-e255b9e9-bffd-426e-84d8-d9dc21c9ea21 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:18:45.532476 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-e255b9e9-bffd-426e-84d8-d9dc21c9ea21 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] [instance: 0a940b67-afa3-4dbd-b665-bff213c051c3] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:18:45.595981 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-e255b9e9-bffd-426e-84d8-d9dc21c9ea21 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923af8dc0f1d4779bf388151093311f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143c400e4544c79955f901394c449f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:18:45.604131 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-e255b9e9-bffd-426e-84d8-d9dc21c9ea21 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] 10.222.0.32 "GET /compute/v2.1/servers/0a940b67-afa3-4dbd-b665-bff213c051c3" status: 200 len: 1094 microversion: 2.1 time: 0.076388 May 30 12:18:45.604981 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 505/998] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:18:45 2022] GET /compute/v2.1/servers/0a940b67-afa3-4dbd-b665-bff213c051c3 => generated 1094 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:18:46.621399 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-2ccb746c-1344-438a-bd7f-68b95834fd29 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:18:46.622926 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-2ccb746c-1344-438a-bd7f-68b95834fd29 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] [instance: 0a940b67-afa3-4dbd-b665-bff213c051c3] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:18:46.632053 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2ccb746c-1344-438a-bd7f-68b95834fd29 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:18:46.632523 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2ccb746c-1344-438a-bd7f-68b95834fd29 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:18:46.633292 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2ccb746c-1344-438a-bd7f-68b95834fd29 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:18:46.633724 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2ccb746c-1344-438a-bd7f-68b95834fd29 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:18:46.701439 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-2ccb746c-1344-438a-bd7f-68b95834fd29 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923af8dc0f1d4779bf388151093311f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143c400e4544c79955f901394c449f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:18:46.710464 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-2ccb746c-1344-438a-bd7f-68b95834fd29 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] 10.222.0.32 "GET /compute/v2.1/servers/0a940b67-afa3-4dbd-b665-bff213c051c3" status: 200 len: 1144 microversion: 2.1 time: 0.092868 May 30 12:18:46.711786 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 494/999] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:18:46 2022] GET /compute/v2.1/servers/0a940b67-afa3-4dbd-b665-bff213c051c3 => generated 1144 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:18:47.728504 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-7f5cc82d-99cb-4658-b4d4-ca096ea61e19 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:18:47.729055 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-7f5cc82d-99cb-4658-b4d4-ca096ea61e19 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] [instance: 0a940b67-afa3-4dbd-b665-bff213c051c3] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:18:47.736957 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7f5cc82d-99cb-4658-b4d4-ca096ea61e19 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:18:47.737484 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7f5cc82d-99cb-4658-b4d4-ca096ea61e19 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:18:47.738280 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7f5cc82d-99cb-4658-b4d4-ca096ea61e19 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:18:47.738721 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7f5cc82d-99cb-4658-b4d4-ca096ea61e19 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:18:47.804574 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-7f5cc82d-99cb-4658-b4d4-ca096ea61e19 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923af8dc0f1d4779bf388151093311f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143c400e4544c79955f901394c449f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:18:47.813254 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-7f5cc82d-99cb-4658-b4d4-ca096ea61e19 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] 10.222.0.32 "GET /compute/v2.1/servers/0a940b67-afa3-4dbd-b665-bff213c051c3" status: 200 len: 1210 microversion: 2.1 time: 0.088791 May 30 12:18:47.824070 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 506/1000] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:18:47 2022] GET /compute/v2.1/servers/0a940b67-afa3-4dbd-b665-bff213c051c3 => generated 1210 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:18:48.837861 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-fbb946db-5af2-4deb-8e16-0130e50650da tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:18:48.838755 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-fbb946db-5af2-4deb-8e16-0130e50650da tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] [instance: 0a940b67-afa3-4dbd-b665-bff213c051c3] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:18:48.846179 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-fbb946db-5af2-4deb-8e16-0130e50650da tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:18:48.846737 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-fbb946db-5af2-4deb-8e16-0130e50650da tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:18:48.847593 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-fbb946db-5af2-4deb-8e16-0130e50650da tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:18:48.848110 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-fbb946db-5af2-4deb-8e16-0130e50650da tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:18:48.985154 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-6551baf2-22a3-45c7-9443-8fa7e0d56f86 req-eda50553-8718-4c22-b2c1-f3ffe5e4555a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a940b67-afa3-4dbd-b665-bff213c051c3", "tag": "cee04f99-b222-40c6-84ee-5af653cc248f"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:18:48.994099 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-6551baf2-22a3-45c7-9443-8fa7e0d56f86 req-eda50553-8718-4c22-b2c1-f3ffe5e4555a service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:18:48.996943 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-6551baf2-22a3-45c7-9443-8fa7e0d56f86 req-eda50553-8718-4c22-b2c1-f3ffe5e4555a service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:18:49.002510 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-fbb946db-5af2-4deb-8e16-0130e50650da tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923af8dc0f1d4779bf388151093311f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143c400e4544c79955f901394c449f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:18:49.011114 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-6551baf2-22a3-45c7-9443-8fa7e0d56f86 req-eda50553-8718-4c22-b2c1-f3ffe5e4555a service nova] Creating event network-changed:cee04f99-b222-40c6-84ee-5af653cc248f for instance 0a940b67-afa3-4dbd-b665-bff213c051c3 on hv-cinder-84051 May 30 12:18:49.012964 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-fbb946db-5af2-4deb-8e16-0130e50650da tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] 10.222.0.32 "GET /compute/v2.1/servers/0a940b67-afa3-4dbd-b665-bff213c051c3" status: 200 len: 1266 microversion: 2.1 time: 0.183053 May 30 12:18:49.014560 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 495/1001] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:18:48 2022] GET /compute/v2.1/servers/0a940b67-afa3-4dbd-b665-bff213c051c3 => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:18:49.017151 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-6551baf2-22a3-45c7-9443-8fa7e0d56f86 req-eda50553-8718-4c22-b2c1-f3ffe5e4555a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038149 May 30 12:18:49.018206 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 507/1002] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:18:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:18:50.030853 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-55f5b4bd-6c33-4e00-92e0-aaad7c1a0594 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:18:50.031473 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-55f5b4bd-6c33-4e00-92e0-aaad7c1a0594 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] [instance: 0a940b67-afa3-4dbd-b665-bff213c051c3] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:18:50.038165 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-55f5b4bd-6c33-4e00-92e0-aaad7c1a0594 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:18:50.038632 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-55f5b4bd-6c33-4e00-92e0-aaad7c1a0594 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:18:50.039411 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-55f5b4bd-6c33-4e00-92e0-aaad7c1a0594 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:18:50.039837 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-55f5b4bd-6c33-4e00-92e0-aaad7c1a0594 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:18:50.185017 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-55f5b4bd-6c33-4e00-92e0-aaad7c1a0594 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923af8dc0f1d4779bf388151093311f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143c400e4544c79955f901394c449f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:18:50.192489 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-55f5b4bd-6c33-4e00-92e0-aaad7c1a0594 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] 10.222.0.32 "GET /compute/v2.1/servers/0a940b67-afa3-4dbd-b665-bff213c051c3" status: 200 len: 1266 microversion: 2.1 time: 0.165788 May 30 12:18:50.193052 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 496/1003] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:18:50 2022] GET /compute/v2.1/servers/0a940b67-afa3-4dbd-b665-bff213c051c3 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:18:51.210841 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-dcf8e9de-3382-4946-82be-9643db6a65f4 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:18:51.211530 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-dcf8e9de-3382-4946-82be-9643db6a65f4 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] [instance: 0a940b67-afa3-4dbd-b665-bff213c051c3] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:18:51.218602 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-dcf8e9de-3382-4946-82be-9643db6a65f4 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:18:51.219041 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-dcf8e9de-3382-4946-82be-9643db6a65f4 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:18:51.219800 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-dcf8e9de-3382-4946-82be-9643db6a65f4 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:18:51.220260 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-dcf8e9de-3382-4946-82be-9643db6a65f4 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:18:51.358171 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-dcf8e9de-3382-4946-82be-9643db6a65f4 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923af8dc0f1d4779bf388151093311f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143c400e4544c79955f901394c449f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:18:51.365754 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-dcf8e9de-3382-4946-82be-9643db6a65f4 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] 10.222.0.32 "GET /compute/v2.1/servers/0a940b67-afa3-4dbd-b665-bff213c051c3" status: 200 len: 1266 microversion: 2.1 time: 0.159703 May 30 12:18:51.366326 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 508/1004] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:18:51 2022] GET /compute/v2.1/servers/0a940b67-afa3-4dbd-b665-bff213c051c3 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:18:52.383258 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-e4b7a404-90ea-4d33-9923-d3e11876ed58 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:18:52.383881 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-e4b7a404-90ea-4d33-9923-d3e11876ed58 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] [instance: 0a940b67-afa3-4dbd-b665-bff213c051c3] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:18:52.391034 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e4b7a404-90ea-4d33-9923-d3e11876ed58 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:18:52.391573 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e4b7a404-90ea-4d33-9923-d3e11876ed58 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:18:52.392406 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e4b7a404-90ea-4d33-9923-d3e11876ed58 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:18:52.392838 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e4b7a404-90ea-4d33-9923-d3e11876ed58 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:18:52.528701 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-e4b7a404-90ea-4d33-9923-d3e11876ed58 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923af8dc0f1d4779bf388151093311f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143c400e4544c79955f901394c449f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:18:52.536855 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-e4b7a404-90ea-4d33-9923-d3e11876ed58 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] 10.222.0.32 "GET /compute/v2.1/servers/0a940b67-afa3-4dbd-b665-bff213c051c3" status: 200 len: 1266 microversion: 2.1 time: 0.157657 May 30 12:18:52.537432 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 497/1005] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:18:52 2022] GET /compute/v2.1/servers/0a940b67-afa3-4dbd-b665-bff213c051c3 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:18:53.554595 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-d332d0b1-9619-4a4b-bc2f-ded94ddc39b7 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:18:53.555195 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-d332d0b1-9619-4a4b-bc2f-ded94ddc39b7 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] [instance: 0a940b67-afa3-4dbd-b665-bff213c051c3] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:18:53.557172 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell0:SELECT=2 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:18:53.563861 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d332d0b1-9619-4a4b-bc2f-ded94ddc39b7 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:18:53.564333 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d332d0b1-9619-4a4b-bc2f-ded94ddc39b7 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:18:53.565091 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d332d0b1-9619-4a4b-bc2f-ded94ddc39b7 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:18:53.565521 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d332d0b1-9619-4a4b-bc2f-ded94ddc39b7 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:18:53.695945 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-d332d0b1-9619-4a4b-bc2f-ded94ddc39b7 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923af8dc0f1d4779bf388151093311f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143c400e4544c79955f901394c449f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:18:53.703780 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-d332d0b1-9619-4a4b-bc2f-ded94ddc39b7 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] 10.222.0.32 "GET /compute/v2.1/servers/0a940b67-afa3-4dbd-b665-bff213c051c3" status: 200 len: 1266 microversion: 2.1 time: 0.152964 May 30 12:18:53.704470 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 509/1006] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:18:53 2022] GET /compute/v2.1/servers/0a940b67-afa3-4dbd-b665-bff213c051c3 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:18:54.720746 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-004dc9d8-ac30-489b-92cb-183f524a35e9 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:18:54.721486 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-004dc9d8-ac30-489b-92cb-183f524a35e9 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] [instance: 0a940b67-afa3-4dbd-b665-bff213c051c3] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:18:54.723775 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell0:SELECT=4 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:18:54.729474 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-004dc9d8-ac30-489b-92cb-183f524a35e9 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:18:54.729925 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-004dc9d8-ac30-489b-92cb-183f524a35e9 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:18:54.730698 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-004dc9d8-ac30-489b-92cb-183f524a35e9 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:18:54.731130 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-004dc9d8-ac30-489b-92cb-183f524a35e9 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:18:54.868547 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-004dc9d8-ac30-489b-92cb-183f524a35e9 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923af8dc0f1d4779bf388151093311f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143c400e4544c79955f901394c449f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:18:54.877129 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-004dc9d8-ac30-489b-92cb-183f524a35e9 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] 10.222.0.32 "GET /compute/v2.1/servers/0a940b67-afa3-4dbd-b665-bff213c051c3" status: 200 len: 1266 microversion: 2.1 time: 0.160344 May 30 12:18:54.877713 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 498/1007] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:18:54 2022] GET /compute/v2.1/servers/0a940b67-afa3-4dbd-b665-bff213c051c3 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:18:55.895053 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-9ef1cce5-9cd1-41df-bc7f-d799d7660313 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:18:55.895620 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-9ef1cce5-9cd1-41df-bc7f-d799d7660313 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] [instance: 0a940b67-afa3-4dbd-b665-bff213c051c3] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:18:55.897886 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell0:SELECT=10 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:18:55.903596 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9ef1cce5-9cd1-41df-bc7f-d799d7660313 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:18:55.904042 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9ef1cce5-9cd1-41df-bc7f-d799d7660313 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:18:55.904850 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9ef1cce5-9cd1-41df-bc7f-d799d7660313 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:18:55.905304 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9ef1cce5-9cd1-41df-bc7f-d799d7660313 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:18:56.041665 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-9ef1cce5-9cd1-41df-bc7f-d799d7660313 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923af8dc0f1d4779bf388151093311f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143c400e4544c79955f901394c449f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:18:56.049570 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-9ef1cce5-9cd1-41df-bc7f-d799d7660313 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] 10.222.0.32 "GET /compute/v2.1/servers/0a940b67-afa3-4dbd-b665-bff213c051c3" status: 200 len: 1266 microversion: 2.1 time: 0.158502 May 30 12:18:56.050130 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 510/1008] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:18:55 2022] GET /compute/v2.1/servers/0a940b67-afa3-4dbd-b665-bff213c051c3 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:18:57.067186 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-b0d0e2cc-d46e-46f4-9740-c944253045b3 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:18:57.067784 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-b0d0e2cc-d46e-46f4-9740-c944253045b3 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] [instance: 0a940b67-afa3-4dbd-b665-bff213c051c3] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:18:57.074287 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b0d0e2cc-d46e-46f4-9740-c944253045b3 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:18:57.074727 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b0d0e2cc-d46e-46f4-9740-c944253045b3 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:18:57.075483 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b0d0e2cc-d46e-46f4-9740-c944253045b3 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:18:57.075913 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b0d0e2cc-d46e-46f4-9740-c944253045b3 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:18:57.211989 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-b0d0e2cc-d46e-46f4-9740-c944253045b3 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923af8dc0f1d4779bf388151093311f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143c400e4544c79955f901394c449f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:18:57.220011 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-b0d0e2cc-d46e-46f4-9740-c944253045b3 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] 10.222.0.32 "GET /compute/v2.1/servers/0a940b67-afa3-4dbd-b665-bff213c051c3" status: 200 len: 1266 microversion: 2.1 time: 0.156615 May 30 12:18:57.220642 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 499/1009] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:18:57 2022] GET /compute/v2.1/servers/0a940b67-afa3-4dbd-b665-bff213c051c3 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:18:58.237408 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-4778bd86-e577-447c-8774-358330cbb99a tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:18:58.238038 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-4778bd86-e577-447c-8774-358330cbb99a tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] [instance: 0a940b67-afa3-4dbd-b665-bff213c051c3] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:18:58.244670 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4778bd86-e577-447c-8774-358330cbb99a tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:18:58.245155 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4778bd86-e577-447c-8774-358330cbb99a tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:18:58.246019 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4778bd86-e577-447c-8774-358330cbb99a tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:18:58.246492 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4778bd86-e577-447c-8774-358330cbb99a tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:18:58.378021 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-4778bd86-e577-447c-8774-358330cbb99a tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923af8dc0f1d4779bf388151093311f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143c400e4544c79955f901394c449f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:18:58.386462 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-4778bd86-e577-447c-8774-358330cbb99a tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] 10.222.0.32 "GET /compute/v2.1/servers/0a940b67-afa3-4dbd-b665-bff213c051c3" status: 200 len: 1266 microversion: 2.1 time: 0.152609 May 30 12:18:58.387525 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 511/1010] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:18:58 2022] GET /compute/v2.1/servers/0a940b67-afa3-4dbd-b665-bff213c051c3 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:18:59.405902 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-09c94677-b44d-42a9-a3ea-17664140d176 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:18:59.406593 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-09c94677-b44d-42a9-a3ea-17664140d176 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] [instance: 0a940b67-afa3-4dbd-b665-bff213c051c3] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:18:59.413523 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-09c94677-b44d-42a9-a3ea-17664140d176 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:18:59.414027 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-09c94677-b44d-42a9-a3ea-17664140d176 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:18:59.414813 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-09c94677-b44d-42a9-a3ea-17664140d176 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:18:59.415286 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-09c94677-b44d-42a9-a3ea-17664140d176 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:18:59.553394 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-06e62a2c-c83a-43e3-afe5-7e3df657d08e req-00055ef2-99aa-4a72-9b25-3624efad1c4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a940b67-afa3-4dbd-b665-bff213c051c3", "name": "network-vif-plugged", "status": "completed", "tag": "cee04f99-b222-40c6-84ee-5af653cc248f"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:18:59.559738 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-09c94677-b44d-42a9-a3ea-17664140d176 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923af8dc0f1d4779bf388151093311f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143c400e4544c79955f901394c449f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:18:59.562717 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-06e62a2c-c83a-43e3-afe5-7e3df657d08e req-00055ef2-99aa-4a72-9b25-3624efad1c4a service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:18:59.563323 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-06e62a2c-c83a-43e3-afe5-7e3df657d08e req-00055ef2-99aa-4a72-9b25-3624efad1c4a service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:18:59.568547 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-09c94677-b44d-42a9-a3ea-17664140d176 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] 10.222.0.32 "GET /compute/v2.1/servers/0a940b67-afa3-4dbd-b665-bff213c051c3" status: 200 len: 1266 microversion: 2.1 time: 0.167022 May 30 12:18:59.569131 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 500/1011] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:18:59 2022] GET /compute/v2.1/servers/0a940b67-afa3-4dbd-b665-bff213c051c3 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:18:59.578601 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-06e62a2c-c83a-43e3-afe5-7e3df657d08e req-00055ef2-99aa-4a72-9b25-3624efad1c4a service nova] Creating event network-vif-plugged:cee04f99-b222-40c6-84ee-5af653cc248f for instance 0a940b67-afa3-4dbd-b665-bff213c051c3 on hv-cinder-84051 May 30 12:18:59.581867 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-06e62a2c-c83a-43e3-afe5-7e3df657d08e req-00055ef2-99aa-4a72-9b25-3624efad1c4a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032966 May 30 12:18:59.582771 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 512/1012] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:18:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 30 12:19:00.587464 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-1001d58a-e57e-46e1-b98c-1ce36cb79d9f tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:19:00.588188 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-1001d58a-e57e-46e1-b98c-1ce36cb79d9f tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] [instance: 0a940b67-afa3-4dbd-b665-bff213c051c3] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:19:00.595526 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1001d58a-e57e-46e1-b98c-1ce36cb79d9f tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:19:00.595974 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1001d58a-e57e-46e1-b98c-1ce36cb79d9f tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:19:00.596766 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1001d58a-e57e-46e1-b98c-1ce36cb79d9f tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:19:00.597201 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1001d58a-e57e-46e1-b98c-1ce36cb79d9f tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:19:00.736634 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-1001d58a-e57e-46e1-b98c-1ce36cb79d9f tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923af8dc0f1d4779bf388151093311f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143c400e4544c79955f901394c449f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:19:00.744110 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-1001d58a-e57e-46e1-b98c-1ce36cb79d9f tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] 10.222.0.32 "GET /compute/v2.1/servers/0a940b67-afa3-4dbd-b665-bff213c051c3" status: 200 len: 1266 microversion: 2.1 time: 0.161297 May 30 12:19:00.744704 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 501/1013] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:19:00 2022] GET /compute/v2.1/servers/0a940b67-afa3-4dbd-b665-bff213c051c3 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:19:01.762833 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-2c54c2b5-c93a-4e1e-9583-12f8c6efb835 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:19:01.763579 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-2c54c2b5-c93a-4e1e-9583-12f8c6efb835 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] [instance: 0a940b67-afa3-4dbd-b665-bff213c051c3] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:19:01.770715 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2c54c2b5-c93a-4e1e-9583-12f8c6efb835 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:19:01.771154 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2c54c2b5-c93a-4e1e-9583-12f8c6efb835 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:19:01.771912 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2c54c2b5-c93a-4e1e-9583-12f8c6efb835 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:19:01.772373 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2c54c2b5-c93a-4e1e-9583-12f8c6efb835 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:19:01.905837 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-2c54c2b5-c93a-4e1e-9583-12f8c6efb835 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923af8dc0f1d4779bf388151093311f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143c400e4544c79955f901394c449f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:19:01.913418 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-2c54c2b5-c93a-4e1e-9583-12f8c6efb835 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] 10.222.0.32 "GET /compute/v2.1/servers/0a940b67-afa3-4dbd-b665-bff213c051c3" status: 200 len: 1452 microversion: 2.1 time: 0.155276 May 30 12:19:01.914098 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 513/1014] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:19:01 2022] GET /compute/v2.1/servers/0a940b67-afa3-4dbd-b665-bff213c051c3 => generated 1452 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:19:01.929584 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-c0d8128b-e222-4b3d-8b04-c9e5b872978e tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:19:01.930205 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-c0d8128b-e222-4b3d-8b04-c9e5b872978e tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] [instance: 0a940b67-afa3-4dbd-b665-bff213c051c3] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:19:01.937166 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c0d8128b-e222-4b3d-8b04-c9e5b872978e tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:19:01.937619 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c0d8128b-e222-4b3d-8b04-c9e5b872978e tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:19:01.938415 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c0d8128b-e222-4b3d-8b04-c9e5b872978e tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:19:01.938851 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c0d8128b-e222-4b3d-8b04-c9e5b872978e tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:19:02.072072 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-c0d8128b-e222-4b3d-8b04-c9e5b872978e tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923af8dc0f1d4779bf388151093311f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143c400e4544c79955f901394c449f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:19:02.080286 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-c0d8128b-e222-4b3d-8b04-c9e5b872978e tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] 10.222.0.32 "GET /compute/v2.1/servers/0a940b67-afa3-4dbd-b665-bff213c051c3" status: 200 len: 1452 microversion: 2.1 time: 0.154481 May 30 12:19:02.080858 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 502/1015] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:19:01 2022] GET /compute/v2.1/servers/0a940b67-afa3-4dbd-b665-bff213c051c3 => generated 1452 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:19:03.786608 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-5a6c0310-e725-4c92-bc8f-addb4c3ab4d9 req-33f2a20e-48cf-4c6a-a363-d555970424ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a940b67-afa3-4dbd-b665-bff213c051c3", "tag": "cee04f99-b222-40c6-84ee-5af653cc248f"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:19:03.795304 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-5a6c0310-e725-4c92-bc8f-addb4c3ab4d9 req-33f2a20e-48cf-4c6a-a363-d555970424ba service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:19:03.796285 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-5a6c0310-e725-4c92-bc8f-addb4c3ab4d9 req-33f2a20e-48cf-4c6a-a363-d555970424ba service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:19:03.807363 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-5a6c0310-e725-4c92-bc8f-addb4c3ab4d9 req-33f2a20e-48cf-4c6a-a363-d555970424ba service nova] Creating event network-changed:cee04f99-b222-40c6-84ee-5af653cc248f for instance 0a940b67-afa3-4dbd-b665-bff213c051c3 on hv-cinder-84051 May 30 12:19:03.812635 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-5a6c0310-e725-4c92-bc8f-addb4c3ab4d9 req-33f2a20e-48cf-4c6a-a363-d555970424ba service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029678 May 30 12:19:03.813433 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 514/1016] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:19:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 30 12:20:49.835967 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 30 12:20:49.836717 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Mon May 30 12:20:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 30 12:21:01.681052 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_api:SELECT=26 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:21:01.681788 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell1:SELECT=54 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:21:01.685621 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-b5621dfa-8d98-4a63-b982-93b3be94eb4c tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:21:01.686108 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-b5621dfa-8d98-4a63-b982-93b3be94eb4c tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] [instance: 0a940b67-afa3-4dbd-b665-bff213c051c3] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:21:01.692811 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b5621dfa-8d98-4a63-b982-93b3be94eb4c tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:21:01.693252 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b5621dfa-8d98-4a63-b982-93b3be94eb4c tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:21:01.694335 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b5621dfa-8d98-4a63-b982-93b3be94eb4c tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:21:01.694765 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b5621dfa-8d98-4a63-b982-93b3be94eb4c tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:21:01.719391 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-b5621dfa-8d98-4a63-b982-93b3be94eb4c tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] [instance: 0a940b67-afa3-4dbd-b665-bff213c051c3] Going to try to terminate instance {{(pid=117670) delete /opt/stack/nova/nova/compute/api.py:2664}} May 30 12:21:01.782058 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b5621dfa-8d98-4a63-b982-93b3be94eb4c tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] [48bf0467-496b-42b3-9ef0-f46a27a2b4b1] AMQP server on 10.222.0.32:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 30 12:21:02.789368 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO oslo.messaging._drivers.impl_rabbit [None req-b5621dfa-8d98-4a63-b982-93b3be94eb4c tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] [48bf0467-496b-42b3-9ef0-f46a27a2b4b1] Reconnected to AMQP server on 10.222.0.32:5672 via [amqp] client with port 58854. May 30 12:21:02.809611 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-b5621dfa-8d98-4a63-b982-93b3be94eb4c tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] 10.222.0.32 "DELETE /compute/v2.1/servers/0a940b67-afa3-4dbd-b665-bff213c051c3" status: 204 len: 0 microversion: 2.1 time: 1.130379 May 30 12:21:02.810179 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 503/1017] 10.222.0.32 () {58 vars in 1238 bytes} [Mon May 30 12:21:01 2022] DELETE /compute/v2.1/servers/0a940b67-afa3-4dbd-b665-bff213c051c3 => generated 0 bytes in 1132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 30 12:21:02.817154 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR oslo.messaging._drivers.impl_rabbit [-] [82e217f2-7696-4d16-93b0-9b8718b82e8d] AMQP server on 10.222.0.32:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 30 12:21:02.819978 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:21:02.820794 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell1:SELECT=44 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:21:02.825880 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-f7370e88-f439-48b4-a52a-dc0c40159c7c tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:21:02.826582 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-f7370e88-f439-48b4-a52a-dc0c40159c7c tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] [instance: 0a940b67-afa3-4dbd-b665-bff213c051c3] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:21:02.834413 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f7370e88-f439-48b4-a52a-dc0c40159c7c tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:21:02.834864 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f7370e88-f439-48b4-a52a-dc0c40159c7c tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:21:02.835630 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f7370e88-f439-48b4-a52a-dc0c40159c7c tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:21:02.836356 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f7370e88-f439-48b4-a52a-dc0c40159c7c tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:21:03.026491 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-f7370e88-f439-48b4-a52a-dc0c40159c7c tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923af8dc0f1d4779bf388151093311f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143c400e4544c79955f901394c449f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:21:03.034062 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-f7370e88-f439-48b4-a52a-dc0c40159c7c tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] 10.222.0.32 "GET /compute/v2.1/servers/0a940b67-afa3-4dbd-b665-bff213c051c3" status: 200 len: 1577 microversion: 2.1 time: 0.219370 May 30 12:21:03.034628 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 515/1018] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:21:02 2022] GET /compute/v2.1/servers/0a940b67-afa3-4dbd-b665-bff213c051c3 => generated 1577 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:21:03.652429 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 30 12:21:03.652620 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Mon May 30 12:21:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 30 12:21:04.053240 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-b7d06089-6da7-424f-acc6-888c662ec722 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:21:04.054046 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-b7d06089-6da7-424f-acc6-888c662ec722 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] [instance: 0a940b67-afa3-4dbd-b665-bff213c051c3] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:21:04.060734 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b7d06089-6da7-424f-acc6-888c662ec722 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:21:04.061182 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b7d06089-6da7-424f-acc6-888c662ec722 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:21:04.061948 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b7d06089-6da7-424f-acc6-888c662ec722 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:21:04.062385 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b7d06089-6da7-424f-acc6-888c662ec722 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:21:04.252040 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-b7d06089-6da7-424f-acc6-888c662ec722 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923af8dc0f1d4779bf388151093311f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143c400e4544c79955f901394c449f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:21:04.260356 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-b7d06089-6da7-424f-acc6-888c662ec722 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] 10.222.0.32 "GET /compute/v2.1/servers/0a940b67-afa3-4dbd-b665-bff213c051c3" status: 200 len: 1577 microversion: 2.1 time: 0.211953 May 30 12:21:04.260921 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 504/1019] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:21:04 2022] GET /compute/v2.1/servers/0a940b67-afa3-4dbd-b665-bff213c051c3 => generated 1577 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:21:05.278435 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-a158cab7-3dc3-4704-90fc-0d0edd20cf94 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:21:05.279032 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-a158cab7-3dc3-4704-90fc-0d0edd20cf94 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] [instance: 0a940b67-afa3-4dbd-b665-bff213c051c3] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:21:05.286875 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a158cab7-3dc3-4704-90fc-0d0edd20cf94 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:21:05.287990 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a158cab7-3dc3-4704-90fc-0d0edd20cf94 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:21:05.289151 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a158cab7-3dc3-4704-90fc-0d0edd20cf94 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:21:05.289585 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a158cab7-3dc3-4704-90fc-0d0edd20cf94 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:21:05.295830 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO oslo.messaging._drivers.impl_rabbit [-] [82e217f2-7696-4d16-93b0-9b8718b82e8d] Reconnected to AMQP server on 10.222.0.32:5672 via [amqp] client with port 58872. May 30 12:21:05.355582 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-a158cab7-3dc3-4704-90fc-0d0edd20cf94 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923af8dc0f1d4779bf388151093311f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143c400e4544c79955f901394c449f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:21:05.363221 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-a158cab7-3dc3-4704-90fc-0d0edd20cf94 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] 10.222.0.32 "GET /compute/v2.1/servers/0a940b67-afa3-4dbd-b665-bff213c051c3" status: 200 len: 1509 microversion: 2.1 time: 0.088948 May 30 12:21:05.363792 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 516/1020] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:21:05 2022] GET /compute/v2.1/servers/0a940b67-afa3-4dbd-b665-bff213c051c3 => generated 1509 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:21:05.490165 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 30 12:21:05.490344 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Mon May 30 12:21:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 30 12:21:05.500878 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-b5b9bb8f-f641-4502-88d3-cb3bf6e429cb req-b4a19f41-82cb-4f92-b096-ad5f855f152f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a940b67-afa3-4dbd-b665-bff213c051c3", "name": "network-vif-deleted", "tag": "cee04f99-b222-40c6-84ee-5af653cc248f"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:21:05.511378 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-b5b9bb8f-f641-4502-88d3-cb3bf6e429cb req-b4a19f41-82cb-4f92-b096-ad5f855f152f service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:21:05.512373 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-b5b9bb8f-f641-4502-88d3-cb3bf6e429cb req-b4a19f41-82cb-4f92-b096-ad5f855f152f service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:21:05.525819 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-b5b9bb8f-f641-4502-88d3-cb3bf6e429cb req-b4a19f41-82cb-4f92-b096-ad5f855f152f service nova] Creating event network-vif-deleted:cee04f99-b222-40c6-84ee-5af653cc248f for instance 0a940b67-afa3-4dbd-b665-bff213c051c3 on hv-cinder-84051 May 30 12:21:05.531668 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-b5b9bb8f-f641-4502-88d3-cb3bf6e429cb req-b4a19f41-82cb-4f92-b096-ad5f855f152f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034287 May 30 12:21:05.532362 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 505/1021] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:21:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:21:06.380516 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-f5c06e3d-9edb-4b14-8975-189510923c36 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:21:06.382035 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-f5c06e3d-9edb-4b14-8975-189510923c36 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] [instance: 0a940b67-afa3-4dbd-b665-bff213c051c3] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:21:06.389447 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f5c06e3d-9edb-4b14-8975-189510923c36 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:21:06.389920 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f5c06e3d-9edb-4b14-8975-189510923c36 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:21:06.390701 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f5c06e3d-9edb-4b14-8975-189510923c36 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:21:06.391132 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f5c06e3d-9edb-4b14-8975-189510923c36 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:21:06.405556 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.wsgi [None req-f5c06e3d-9edb-4b14-8975-189510923c36 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] HTTP exception thrown: Instance 0a940b67-afa3-4dbd-b665-bff213c051c3 could not be found. May 30 12:21:06.407259 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-f5c06e3d-9edb-4b14-8975-189510923c36 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Request method failure captured: May 30 12:21:06.407259 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: request: GET /compute/v2.1/servers/0a940b67-afa3-4dbd-b665-bff213c051c3 HTTP/1.1 May 30 12:21:06.407259 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Accept: application/json May 30 12:21:06.407259 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Accept-Encoding: identity May 30 12:21:06.407259 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Connection: close May 30 12:21:06.407259 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Content-Length: 0 May 30 12:21:06.407259 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Content-Type: application/json May 30 12:21:06.407259 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Host: 10.222.0.32 May 30 12:21:06.407259 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Openstack-System-Scope: None May 30 12:21:06.407259 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: User-Agent: python-urllib3/1.26.9 May 30 12:21:06.407259 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Auth-Token: gAAAAABilLYJ8yD9zjHsgwVNhwmlOc84aR0-ls_eOuOFz5m7ew82a65Im6Z5tPXeZEvIgPz3JSvQMJIX4Ds_E74k3HnvajayX0QYGJEXNA8CQ6dAp-eAWEOPynREKg7GvzXvPpjW-8GWPRYhWLBp871ZPukmRxEicEgMhPRbwUt9L1aDIsLcjZY May 30 12:21:06.407259 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Domain-Id: None May 30 12:21:06.407259 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Domain-Name: None May 30 12:21:06.407259 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Identity-Status: Confirmed May 30 12:21:06.407259 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Is-Admin-Project: True May 30 12:21:06.407259 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Domain-Id: default May 30 12:21:06.407259 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Domain-Name: Default May 30 12:21:06.407259 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Id: 5143c400e4544c79955f901394c449f6 May 30 12:21:06.407259 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Name: tempest-TestVolumeBootPattern-1287587269 May 30 12:21:06.407259 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Role: reader,member May 30 12:21:06.407259 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Roles: reader,member May 30 12:21:06.408984 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/5143c400e4544c79955f901394c449f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/5143c400e4544c79955f901394c449f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/5143c400e4544c79955f901394c449f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_5143c400e4544c79955f901394c449f6", "adminURL": "http://10.222.0.32:8080"}]}] May 30 12:21:06.408984 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Tenant: tempest-TestVolumeBootPattern-1287587269 May 30 12:21:06.408984 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Tenant-Id: 5143c400e4544c79955f901394c449f6 May 30 12:21:06.408984 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Tenant-Name: tempest-TestVolumeBootPattern-1287587269 May 30 12:21:06.408984 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User: tempest-TestVolumeBootPattern-1287587269-project May 30 12:21:06.408984 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Domain-Id: default May 30 12:21:06.408984 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Domain-Name: Default May 30 12:21:06.408984 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Id: 923af8dc0f1d4779bf388151093311f6 May 30 12:21:06.408984 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Name: tempest-TestVolumeBootPattern-1287587269-project May 30 12:21:06.408984 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: method: > May 30 12:21:06.408984 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: exception: Instance 0a940b67-afa3-4dbd-b665-bff213c051c3 could not be found. May 30 12:21:06.408984 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: action_args: {'id': '0a940b67-afa3-4dbd-b665-bff213c051c3'} May 30 12:21:06.409981 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:21:06.409981 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:21:06.409981 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:21:06.409981 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:21:06.409981 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:21:06.409981 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:21:06.409981 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:21:06.409981 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:21:06.409981 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:21:06.409981 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:21:06.409981 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a940b67-afa3-4dbd-b665-bff213c051c3 could not be found. May 30 12:21:06.409981 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:21:06.409981 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:21:06.409981 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:21:06.409981 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:21:06.409981 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:21:06.409981 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:21:06.409981 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:21:06.409981 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:21:06.409981 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:21:06.411348 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:21:06.411348 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 30 12:21:06.411348 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 30 12:21:06.411348 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 30 12:21:06.411348 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 30 12:21:06.411348 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:21:06.411348 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:21:06.411348 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a940b67-afa3-4dbd-b665-bff213c051c3 could not be found. May 30 12:21:06.411348 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:21:06.411348 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:21:06.411348 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:21:06.411348 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:21:06.411348 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:21:06.411348 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:21:06.411348 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:21:06.411348 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:21:06.411348 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a940b67-afa3-4dbd-b665-bff213c051c3 could not be found. May 30 12:21:06.411348 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:21:06.415170 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-f5c06e3d-9edb-4b14-8975-189510923c36 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Returning 404 to user: Instance 0a940b67-afa3-4dbd-b665-bff213c051c3 could not be found. {{(pid=117671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:21:06.415170 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-f5c06e3d-9edb-4b14-8975-189510923c36 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] 10.222.0.32 "GET /compute/v2.1/servers/0a940b67-afa3-4dbd-b665-bff213c051c3" status: 404 len: 111 microversion: 2.1 time: 0.032171 May 30 12:21:06.415170 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 517/1022] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:21:06 2022] GET /compute/v2.1/servers/0a940b67-afa3-4dbd-b665-bff213c051c3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 30 12:21:06.463891 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-b4766e3c-9e7f-45cc-8b6f-ade08cb1c331 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1799200489", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1330641870", "security_groups": [{"name": "tempest-secgroup-smoke-2037472610"}], "block_device_mapping_v2": [{"uuid": "e0ee822b-25b8-4e94-99b5-6f43dcb9b536", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "912f6667-0e8d-45c3-8e3f-950b457426b6"}]}} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:21:06.588469 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.network.neutron [None req-b4766e3c-9e7f-45cc-8b6f-ade08cb1c331 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] validate_networks() for [('912f6667-0e8d-45c3-8e3f-950b457426b6', None, None, None, None, None)] {{(pid=117670) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 30 12:21:07.276967 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-b4766e3c-9e7f-45cc-8b6f-ade08cb1c331 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Flavor limits 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 30 12:21:07.277413 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-b4766e3c-9e7f-45cc-8b6f-ade08cb1c331 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Image limits 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 30 12:21:07.278063 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-b4766e3c-9e7f-45cc-8b6f-ade08cb1c331 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Flavor pref 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 30 12:21:07.278716 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-b4766e3c-9e7f-45cc-8b6f-ade08cb1c331 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Image pref 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 30 12:21:07.278992 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-b4766e3c-9e7f-45cc-8b6f-ade08cb1c331 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 30 12:21:07.289333 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b4766e3c-9e7f-45cc-8b6f-ade08cb1c331 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:21:07.289779 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b4766e3c-9e7f-45cc-8b6f-ade08cb1c331 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:21:07.290585 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b4766e3c-9e7f-45cc-8b6f-ade08cb1c331 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:21:07.291014 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b4766e3c-9e7f-45cc-8b6f-ade08cb1c331 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:21:07.308206 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.quota [None req-b4766e3c-9e7f-45cc-8b6f-ade08cb1c331 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Getting quotas for project 5143c400e4544c79955f901394c449f6. Resources: {'cores', 'instances', 'ram'} {{(pid=117670) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 30 12:21:07.312117 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.quota [None req-b4766e3c-9e7f-45cc-8b6f-ade08cb1c331 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Getting quotas for user 923af8dc0f1d4779bf388151093311f6 and project 5143c400e4544c79955f901394c449f6. Resources: {'cores', 'instances', 'ram'} {{(pid=117670) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 30 12:21:07.371406 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-b4766e3c-9e7f-45cc-8b6f-ade08cb1c331 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Going to run 1 instances... {{(pid=117670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 30 12:21:07.373620 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-b4766e3c-9e7f-45cc-8b6f-ade08cb1c331 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] [instance: 6063ef32-6212-4feb-b3f1-4ec57a283a85] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e0ee822b-25b8-4e94-99b5-6f43dcb9b536',volume_size=None,volume_type=None)] {{(pid=117670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 30 12:21:07.504009 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-b4766e3c-9e7f-45cc-8b6f-ade08cb1c331 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.047632 May 30 12:21:07.504746 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 506/1023] 10.222.0.32 () {60 vars in 1146 bytes} [Mon May 30 12:21:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 1050 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 30 12:21:07.514961 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-41c108b2-ed17-48ed-9051-99c4e0ae8e5a tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:21:07.515573 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-41c108b2-ed17-48ed-9051-99c4e0ae8e5a tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] [instance: 6063ef32-6212-4feb-b3f1-4ec57a283a85] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:21:07.575077 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-41c108b2-ed17-48ed-9051-99c4e0ae8e5a tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923af8dc0f1d4779bf388151093311f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143c400e4544c79955f901394c449f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:21:07.582347 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-41c108b2-ed17-48ed-9051-99c4e0ae8e5a tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] 10.222.0.32 "GET /compute/v2.1/servers/6063ef32-6212-4feb-b3f1-4ec57a283a85" status: 200 len: 1095 microversion: 2.1 time: 0.071234 May 30 12:21:07.582924 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 518/1024] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:21:07 2022] GET /compute/v2.1/servers/6063ef32-6212-4feb-b3f1-4ec57a283a85 => generated 1095 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:21:08.599553 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-f71b1624-836a-4886-a030-e5ced46946e1 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:21:08.600365 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-f71b1624-836a-4886-a030-e5ced46946e1 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] [instance: 6063ef32-6212-4feb-b3f1-4ec57a283a85] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:21:08.608533 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f71b1624-836a-4886-a030-e5ced46946e1 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:21:08.609688 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f71b1624-836a-4886-a030-e5ced46946e1 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:21:08.612101 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f71b1624-836a-4886-a030-e5ced46946e1 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:21:08.612599 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f71b1624-836a-4886-a030-e5ced46946e1 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:21:08.684936 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-f71b1624-836a-4886-a030-e5ced46946e1 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923af8dc0f1d4779bf388151093311f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143c400e4544c79955f901394c449f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:21:08.693076 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-f71b1624-836a-4886-a030-e5ced46946e1 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] 10.222.0.32 "GET /compute/v2.1/servers/6063ef32-6212-4feb-b3f1-4ec57a283a85" status: 200 len: 1211 microversion: 2.1 time: 0.097393 May 30 12:21:08.693702 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 507/1025] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:21:08 2022] GET /compute/v2.1/servers/6063ef32-6212-4feb-b3f1-4ec57a283a85 => generated 1211 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:21:09.711157 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-5f637a30-68b2-46a9-b136-f2d7504e497b tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:21:09.711774 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-5f637a30-68b2-46a9-b136-f2d7504e497b tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] [instance: 6063ef32-6212-4feb-b3f1-4ec57a283a85] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:21:09.719069 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5f637a30-68b2-46a9-b136-f2d7504e497b tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:21:09.719519 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5f637a30-68b2-46a9-b136-f2d7504e497b tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:21:09.720315 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5f637a30-68b2-46a9-b136-f2d7504e497b tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:21:09.720752 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5f637a30-68b2-46a9-b136-f2d7504e497b tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:21:09.854747 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-5f637a30-68b2-46a9-b136-f2d7504e497b tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923af8dc0f1d4779bf388151093311f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143c400e4544c79955f901394c449f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:21:09.862320 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-5f637a30-68b2-46a9-b136-f2d7504e497b tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] 10.222.0.32 "GET /compute/v2.1/servers/6063ef32-6212-4feb-b3f1-4ec57a283a85" status: 200 len: 1267 microversion: 2.1 time: 0.155774 May 30 12:21:09.862889 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 519/1026] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:21:09 2022] GET /compute/v2.1/servers/6063ef32-6212-4feb-b3f1-4ec57a283a85 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:21:10.178191 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-d5b40909-8170-4d15-b5bf-a64d74f8b3d3 req-1587b9e5-b05e-4bf2-8318-ee540bad0000 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6063ef32-6212-4feb-b3f1-4ec57a283a85", "tag": "d462e5dd-3dc2-4ca4-ab3a-7705b09c8d8b"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:21:10.195435 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-d5b40909-8170-4d15-b5bf-a64d74f8b3d3 req-1587b9e5-b05e-4bf2-8318-ee540bad0000 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:21:10.196230 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-d5b40909-8170-4d15-b5bf-a64d74f8b3d3 req-1587b9e5-b05e-4bf2-8318-ee540bad0000 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:21:10.209353 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-d5b40909-8170-4d15-b5bf-a64d74f8b3d3 req-1587b9e5-b05e-4bf2-8318-ee540bad0000 service nova] Creating event network-changed:d462e5dd-3dc2-4ca4-ab3a-7705b09c8d8b for instance 6063ef32-6212-4feb-b3f1-4ec57a283a85 on hv-cinder-84051 May 30 12:21:10.214948 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-d5b40909-8170-4d15-b5bf-a64d74f8b3d3 req-1587b9e5-b05e-4bf2-8318-ee540bad0000 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040285 May 30 12:21:10.216243 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 508/1027] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:21:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:21:10.879629 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-1e64f8da-ff76-4b59-87df-d80235791527 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:21:10.880205 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-1e64f8da-ff76-4b59-87df-d80235791527 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] [instance: 6063ef32-6212-4feb-b3f1-4ec57a283a85] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:21:10.887516 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1e64f8da-ff76-4b59-87df-d80235791527 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:21:10.887970 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1e64f8da-ff76-4b59-87df-d80235791527 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:21:10.888787 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1e64f8da-ff76-4b59-87df-d80235791527 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:21:10.889222 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1e64f8da-ff76-4b59-87df-d80235791527 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:21:11.024696 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-1e64f8da-ff76-4b59-87df-d80235791527 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923af8dc0f1d4779bf388151093311f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143c400e4544c79955f901394c449f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:21:11.033056 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-1e64f8da-ff76-4b59-87df-d80235791527 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] 10.222.0.32 "GET /compute/v2.1/servers/6063ef32-6212-4feb-b3f1-4ec57a283a85" status: 200 len: 1267 microversion: 2.1 time: 0.157365 May 30 12:21:11.033719 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 520/1028] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:21:10 2022] GET /compute/v2.1/servers/6063ef32-6212-4feb-b3f1-4ec57a283a85 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:21:12.051744 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-d1b99f29-2b80-4e1e-9efe-76f5771a660f tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:21:12.052480 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-d1b99f29-2b80-4e1e-9efe-76f5771a660f tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] [instance: 6063ef32-6212-4feb-b3f1-4ec57a283a85] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:21:12.059528 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d1b99f29-2b80-4e1e-9efe-76f5771a660f tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:21:12.059965 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d1b99f29-2b80-4e1e-9efe-76f5771a660f tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:21:12.060788 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d1b99f29-2b80-4e1e-9efe-76f5771a660f tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:21:12.061226 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d1b99f29-2b80-4e1e-9efe-76f5771a660f tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:21:12.191610 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-d1b99f29-2b80-4e1e-9efe-76f5771a660f tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923af8dc0f1d4779bf388151093311f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143c400e4544c79955f901394c449f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:21:12.199774 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-d1b99f29-2b80-4e1e-9efe-76f5771a660f tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] 10.222.0.32 "GET /compute/v2.1/servers/6063ef32-6212-4feb-b3f1-4ec57a283a85" status: 200 len: 1267 microversion: 2.1 time: 0.152745 May 30 12:21:12.200449 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 509/1029] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:21:12 2022] GET /compute/v2.1/servers/6063ef32-6212-4feb-b3f1-4ec57a283a85 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:21:13.217179 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-196f67b2-5486-4519-9725-c931ae595b96 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:21:13.217771 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-196f67b2-5486-4519-9725-c931ae595b96 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] [instance: 6063ef32-6212-4feb-b3f1-4ec57a283a85] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:21:13.224403 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-196f67b2-5486-4519-9725-c931ae595b96 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:21:13.224851 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-196f67b2-5486-4519-9725-c931ae595b96 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:21:13.225645 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-196f67b2-5486-4519-9725-c931ae595b96 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:21:13.226077 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-196f67b2-5486-4519-9725-c931ae595b96 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:21:13.357596 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-196f67b2-5486-4519-9725-c931ae595b96 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923af8dc0f1d4779bf388151093311f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143c400e4544c79955f901394c449f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:21:13.365217 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-196f67b2-5486-4519-9725-c931ae595b96 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] 10.222.0.32 "GET /compute/v2.1/servers/6063ef32-6212-4feb-b3f1-4ec57a283a85" status: 200 len: 1267 microversion: 2.1 time: 0.151949 May 30 12:21:13.365788 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 521/1030] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:21:13 2022] GET /compute/v2.1/servers/6063ef32-6212-4feb-b3f1-4ec57a283a85 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:21:14.381962 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-f6f769f5-03a5-4611-ad27-f1e057bc3494 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:21:14.382660 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-f6f769f5-03a5-4611-ad27-f1e057bc3494 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] [instance: 6063ef32-6212-4feb-b3f1-4ec57a283a85] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:21:14.388772 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f6f769f5-03a5-4611-ad27-f1e057bc3494 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:21:14.389229 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f6f769f5-03a5-4611-ad27-f1e057bc3494 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:21:14.389992 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f6f769f5-03a5-4611-ad27-f1e057bc3494 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:21:14.390434 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f6f769f5-03a5-4611-ad27-f1e057bc3494 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:21:14.526077 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-f6f769f5-03a5-4611-ad27-f1e057bc3494 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923af8dc0f1d4779bf388151093311f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143c400e4544c79955f901394c449f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:21:14.533576 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-f6f769f5-03a5-4611-ad27-f1e057bc3494 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] 10.222.0.32 "GET /compute/v2.1/servers/6063ef32-6212-4feb-b3f1-4ec57a283a85" status: 200 len: 1267 microversion: 2.1 time: 0.156428 May 30 12:21:14.534147 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 510/1031] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:21:14 2022] GET /compute/v2.1/servers/6063ef32-6212-4feb-b3f1-4ec57a283a85 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:21:15.550352 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-16a85fda-d335-464a-b735-a65a970a2dca tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:21:15.550944 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-16a85fda-d335-464a-b735-a65a970a2dca tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] [instance: 6063ef32-6212-4feb-b3f1-4ec57a283a85] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:21:15.557784 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-16a85fda-d335-464a-b735-a65a970a2dca tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:21:15.558226 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-16a85fda-d335-464a-b735-a65a970a2dca tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:21:15.558978 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-16a85fda-d335-464a-b735-a65a970a2dca tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:21:15.559411 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-16a85fda-d335-464a-b735-a65a970a2dca tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:21:15.697939 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-16a85fda-d335-464a-b735-a65a970a2dca tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923af8dc0f1d4779bf388151093311f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143c400e4544c79955f901394c449f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:21:15.705412 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-16a85fda-d335-464a-b735-a65a970a2dca tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] 10.222.0.32 "GET /compute/v2.1/servers/6063ef32-6212-4feb-b3f1-4ec57a283a85" status: 200 len: 1267 microversion: 2.1 time: 0.158954 May 30 12:21:15.705975 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 522/1032] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:21:15 2022] GET /compute/v2.1/servers/6063ef32-6212-4feb-b3f1-4ec57a283a85 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:21:16.722686 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-cb008550-7dfd-41af-b57b-bbc788fe6869 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:21:16.723253 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-cb008550-7dfd-41af-b57b-bbc788fe6869 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] [instance: 6063ef32-6212-4feb-b3f1-4ec57a283a85] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:21:16.730840 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-cb008550-7dfd-41af-b57b-bbc788fe6869 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:21:16.731286 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-cb008550-7dfd-41af-b57b-bbc788fe6869 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:21:16.732046 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-cb008550-7dfd-41af-b57b-bbc788fe6869 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:21:16.732503 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-cb008550-7dfd-41af-b57b-bbc788fe6869 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:21:16.869800 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-cb008550-7dfd-41af-b57b-bbc788fe6869 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923af8dc0f1d4779bf388151093311f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143c400e4544c79955f901394c449f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:21:16.881572 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-cb008550-7dfd-41af-b57b-bbc788fe6869 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] 10.222.0.32 "GET /compute/v2.1/servers/6063ef32-6212-4feb-b3f1-4ec57a283a85" status: 200 len: 1267 microversion: 2.1 time: 0.162432 May 30 12:21:16.882505 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 511/1033] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:21:16 2022] GET /compute/v2.1/servers/6063ef32-6212-4feb-b3f1-4ec57a283a85 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:21:17.899758 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-1514f893-28a8-46fa-9add-871fd70a8f5a tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:21:17.900387 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-1514f893-28a8-46fa-9add-871fd70a8f5a tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] [instance: 6063ef32-6212-4feb-b3f1-4ec57a283a85] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:21:17.903634 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell0:SELECT=2 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:21:17.909269 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1514f893-28a8-46fa-9add-871fd70a8f5a tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:21:17.909710 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1514f893-28a8-46fa-9add-871fd70a8f5a tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:21:17.910466 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1514f893-28a8-46fa-9add-871fd70a8f5a tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:21:17.910892 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1514f893-28a8-46fa-9add-871fd70a8f5a tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:21:18.042063 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-1514f893-28a8-46fa-9add-871fd70a8f5a tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923af8dc0f1d4779bf388151093311f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143c400e4544c79955f901394c449f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:21:18.049809 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-1514f893-28a8-46fa-9add-871fd70a8f5a tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] 10.222.0.32 "GET /compute/v2.1/servers/6063ef32-6212-4feb-b3f1-4ec57a283a85" status: 200 len: 1267 microversion: 2.1 time: 0.153904 May 30 12:21:18.050386 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 523/1034] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:21:17 2022] GET /compute/v2.1/servers/6063ef32-6212-4feb-b3f1-4ec57a283a85 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:21:19.067245 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-36fbf3f2-e185-452d-8ee5-4ce69ace1d23 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:21:19.067852 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-36fbf3f2-e185-452d-8ee5-4ce69ace1d23 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] [instance: 6063ef32-6212-4feb-b3f1-4ec57a283a85] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:21:19.069845 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell0:SELECT=2 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:21:19.070504 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell0:SELECT=6 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:21:19.076901 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-36fbf3f2-e185-452d-8ee5-4ce69ace1d23 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:21:19.077348 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-36fbf3f2-e185-452d-8ee5-4ce69ace1d23 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:21:19.078113 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-36fbf3f2-e185-452d-8ee5-4ce69ace1d23 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:21:19.078550 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-36fbf3f2-e185-452d-8ee5-4ce69ace1d23 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:21:19.212487 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-36fbf3f2-e185-452d-8ee5-4ce69ace1d23 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923af8dc0f1d4779bf388151093311f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143c400e4544c79955f901394c449f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:21:19.220117 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-36fbf3f2-e185-452d-8ee5-4ce69ace1d23 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] 10.222.0.32 "GET /compute/v2.1/servers/6063ef32-6212-4feb-b3f1-4ec57a283a85" status: 200 len: 1267 microversion: 2.1 time: 0.156736 May 30 12:21:19.220741 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 512/1035] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:21:19 2022] GET /compute/v2.1/servers/6063ef32-6212-4feb-b3f1-4ec57a283a85 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:21:20.241272 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-8e2d7f8b-265e-4223-95cd-039f656b75a2 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:21:20.241889 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-8e2d7f8b-265e-4223-95cd-039f656b75a2 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] [instance: 6063ef32-6212-4feb-b3f1-4ec57a283a85] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:21:20.249202 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8e2d7f8b-265e-4223-95cd-039f656b75a2 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:21:20.249658 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8e2d7f8b-265e-4223-95cd-039f656b75a2 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:21:20.250425 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8e2d7f8b-265e-4223-95cd-039f656b75a2 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:21:20.251557 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8e2d7f8b-265e-4223-95cd-039f656b75a2 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:21:20.392210 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-8e2d7f8b-265e-4223-95cd-039f656b75a2 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923af8dc0f1d4779bf388151093311f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143c400e4544c79955f901394c449f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:21:20.399793 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-8e2d7f8b-265e-4223-95cd-039f656b75a2 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] 10.222.0.32 "GET /compute/v2.1/servers/6063ef32-6212-4feb-b3f1-4ec57a283a85" status: 200 len: 1267 microversion: 2.1 time: 0.162486 May 30 12:21:20.401172 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 524/1036] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:21:20 2022] GET /compute/v2.1/servers/6063ef32-6212-4feb-b3f1-4ec57a283a85 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:21:21.417837 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-47bd3f72-9a53-43d4-a94d-b99775d72a08 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:21:21.418436 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-47bd3f72-9a53-43d4-a94d-b99775d72a08 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] [instance: 6063ef32-6212-4feb-b3f1-4ec57a283a85] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:21:21.425131 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-47bd3f72-9a53-43d4-a94d-b99775d72a08 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:21:21.425858 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-47bd3f72-9a53-43d4-a94d-b99775d72a08 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:21:21.426893 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-47bd3f72-9a53-43d4-a94d-b99775d72a08 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:21:21.427594 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-47bd3f72-9a53-43d4-a94d-b99775d72a08 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:21:21.557475 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-47bd3f72-9a53-43d4-a94d-b99775d72a08 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923af8dc0f1d4779bf388151093311f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143c400e4544c79955f901394c449f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:21:21.565071 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-47bd3f72-9a53-43d4-a94d-b99775d72a08 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] 10.222.0.32 "GET /compute/v2.1/servers/6063ef32-6212-4feb-b3f1-4ec57a283a85" status: 200 len: 1267 microversion: 2.1 time: 0.151702 May 30 12:21:21.565648 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 513/1037] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:21:21 2022] GET /compute/v2.1/servers/6063ef32-6212-4feb-b3f1-4ec57a283a85 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:21:22.194716 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-51ab385c-f1bd-4954-b3ab-d56013ccc189 req-a554410e-cdd3-43db-b31a-0513640b8d24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6063ef32-6212-4feb-b3f1-4ec57a283a85", "name": "network-vif-plugged", "status": "completed", "tag": "d462e5dd-3dc2-4ca4-ab3a-7705b09c8d8b"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:21:22.204603 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-51ab385c-f1bd-4954-b3ab-d56013ccc189 req-a554410e-cdd3-43db-b31a-0513640b8d24 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:21:22.205051 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-51ab385c-f1bd-4954-b3ab-d56013ccc189 req-a554410e-cdd3-43db-b31a-0513640b8d24 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:21:22.218562 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-51ab385c-f1bd-4954-b3ab-d56013ccc189 req-a554410e-cdd3-43db-b31a-0513640b8d24 service nova] Creating event network-vif-plugged:d462e5dd-3dc2-4ca4-ab3a-7705b09c8d8b for instance 6063ef32-6212-4feb-b3f1-4ec57a283a85 on hv-cinder-84051 May 30 12:21:22.222075 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR oslo.messaging._drivers.impl_rabbit [req-51ab385c-f1bd-4954-b3ab-d56013ccc189 req-a554410e-cdd3-43db-b31a-0513640b8d24 service nova] [2c33b4bd-5135-40f5-847e-50cd9cf952dd] AMQP server on 10.222.0.32:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 30 12:21:22.582053 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-ab30cd08-e229-48de-a4f4-2244e287ff5c tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:21:22.582668 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-ab30cd08-e229-48de-a4f4-2244e287ff5c tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] [instance: 6063ef32-6212-4feb-b3f1-4ec57a283a85] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:21:22.589781 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ab30cd08-e229-48de-a4f4-2244e287ff5c tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:21:22.590208 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ab30cd08-e229-48de-a4f4-2244e287ff5c tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:21:22.590982 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ab30cd08-e229-48de-a4f4-2244e287ff5c tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:21:22.591425 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ab30cd08-e229-48de-a4f4-2244e287ff5c tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:21:22.725528 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-ab30cd08-e229-48de-a4f4-2244e287ff5c tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923af8dc0f1d4779bf388151093311f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143c400e4544c79955f901394c449f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:21:22.733912 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-ab30cd08-e229-48de-a4f4-2244e287ff5c tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] 10.222.0.32 "GET /compute/v2.1/servers/6063ef32-6212-4feb-b3f1-4ec57a283a85" status: 200 len: 1267 microversion: 2.1 time: 0.155653 May 30 12:21:22.734689 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 514/1038] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:21:22 2022] GET /compute/v2.1/servers/6063ef32-6212-4feb-b3f1-4ec57a283a85 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:21:23.228528 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO oslo.messaging._drivers.impl_rabbit [req-51ab385c-f1bd-4954-b3ab-d56013ccc189 req-a554410e-cdd3-43db-b31a-0513640b8d24 service nova] [2c33b4bd-5135-40f5-847e-50cd9cf952dd] Reconnected to AMQP server on 10.222.0.32:5672 via [amqp] client with port 58940. May 30 12:21:23.231802 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-51ab385c-f1bd-4954-b3ab-d56013ccc189 req-a554410e-cdd3-43db-b31a-0513640b8d24 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.041341 May 30 12:21:23.232447 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 525/1039] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:21:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:21:23.751513 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-ad764064-6719-4f38-8d14-7ba631cd6558 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:21:23.752126 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-ad764064-6719-4f38-8d14-7ba631cd6558 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] [instance: 6063ef32-6212-4feb-b3f1-4ec57a283a85] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:21:23.758629 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ad764064-6719-4f38-8d14-7ba631cd6558 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:21:23.759080 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ad764064-6719-4f38-8d14-7ba631cd6558 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:21:23.760410 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ad764064-6719-4f38-8d14-7ba631cd6558 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:21:23.761026 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ad764064-6719-4f38-8d14-7ba631cd6558 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:21:23.891340 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-ad764064-6719-4f38-8d14-7ba631cd6558 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923af8dc0f1d4779bf388151093311f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143c400e4544c79955f901394c449f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:21:23.898899 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-ad764064-6719-4f38-8d14-7ba631cd6558 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] 10.222.0.32 "GET /compute/v2.1/servers/6063ef32-6212-4feb-b3f1-4ec57a283a85" status: 200 len: 1267 microversion: 2.1 time: 0.151582 May 30 12:21:23.899467 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 515/1040] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:21:23 2022] GET /compute/v2.1/servers/6063ef32-6212-4feb-b3f1-4ec57a283a85 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:21:24.918303 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-c1b4b056-ba1d-4890-aa0d-14b1fed27dff tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:21:24.918944 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-c1b4b056-ba1d-4890-aa0d-14b1fed27dff tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] [instance: 6063ef32-6212-4feb-b3f1-4ec57a283a85] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:21:24.925303 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c1b4b056-ba1d-4890-aa0d-14b1fed27dff tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:21:24.925752 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c1b4b056-ba1d-4890-aa0d-14b1fed27dff tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:21:24.926518 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c1b4b056-ba1d-4890-aa0d-14b1fed27dff tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:21:24.926953 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c1b4b056-ba1d-4890-aa0d-14b1fed27dff tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:21:25.062850 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-c1b4b056-ba1d-4890-aa0d-14b1fed27dff tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923af8dc0f1d4779bf388151093311f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143c400e4544c79955f901394c449f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:21:25.070417 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-c1b4b056-ba1d-4890-aa0d-14b1fed27dff tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] 10.222.0.32 "GET /compute/v2.1/servers/6063ef32-6212-4feb-b3f1-4ec57a283a85" status: 200 len: 1454 microversion: 2.1 time: 0.157682 May 30 12:21:25.071382 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 526/1041] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:21:24 2022] GET /compute/v2.1/servers/6063ef32-6212-4feb-b3f1-4ec57a283a85 => generated 1454 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:21:25.090587 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-c8214d5d-390a-447c-856d-eb6c6f48e827 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:21:25.091184 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-c8214d5d-390a-447c-856d-eb6c6f48e827 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] [instance: 6063ef32-6212-4feb-b3f1-4ec57a283a85] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:21:25.097713 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c8214d5d-390a-447c-856d-eb6c6f48e827 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:21:25.098192 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c8214d5d-390a-447c-856d-eb6c6f48e827 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:21:25.098960 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c8214d5d-390a-447c-856d-eb6c6f48e827 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:21:25.099489 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c8214d5d-390a-447c-856d-eb6c6f48e827 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:21:25.236139 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-c8214d5d-390a-447c-856d-eb6c6f48e827 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923af8dc0f1d4779bf388151093311f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143c400e4544c79955f901394c449f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:21:25.243600 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-c8214d5d-390a-447c-856d-eb6c6f48e827 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] 10.222.0.32 "GET /compute/v2.1/servers/6063ef32-6212-4feb-b3f1-4ec57a283a85" status: 200 len: 1454 microversion: 2.1 time: 0.157576 May 30 12:21:25.244209 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 516/1042] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:21:25 2022] GET /compute/v2.1/servers/6063ef32-6212-4feb-b3f1-4ec57a283a85 => generated 1454 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:21:26.866593 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-e97bc35a-71ef-4d53-bad9-ee6e8cb4f9a9 req-3c461513-dac7-479a-bdfe-d958756192c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6063ef32-6212-4feb-b3f1-4ec57a283a85", "tag": "d462e5dd-3dc2-4ca4-ab3a-7705b09c8d8b"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:21:26.876114 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-e97bc35a-71ef-4d53-bad9-ee6e8cb4f9a9 req-3c461513-dac7-479a-bdfe-d958756192c4 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:21:26.876817 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-e97bc35a-71ef-4d53-bad9-ee6e8cb4f9a9 req-3c461513-dac7-479a-bdfe-d958756192c4 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:21:26.889053 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-e97bc35a-71ef-4d53-bad9-ee6e8cb4f9a9 req-3c461513-dac7-479a-bdfe-d958756192c4 service nova] Creating event network-changed:d462e5dd-3dc2-4ca4-ab3a-7705b09c8d8b for instance 6063ef32-6212-4feb-b3f1-4ec57a283a85 on hv-cinder-84051 May 30 12:21:26.894332 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-e97bc35a-71ef-4d53-bad9-ee6e8cb4f9a9 req-3c461513-dac7-479a-bdfe-d958756192c4 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032050 May 30 12:21:26.895314 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 527/1043] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:21:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:23:02.219524 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:23:02.220301 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:23:02.224511 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-eee508b8-5725-4ccd-9232-dc85adb0aa50 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1748243539", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1330641870", "security_groups": [{"name": "tempest-secgroup-smoke-2037472610"}], "block_device_mapping_v2": [{"uuid": "4fa582a2-fd20-4e15-939a-da29cd6d8b26", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "912f6667-0e8d-45c3-8e3f-950b457426b6"}]}} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:23:02.339628 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.network.neutron [None req-eee508b8-5725-4ccd-9232-dc85adb0aa50 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] validate_networks() for [('912f6667-0e8d-45c3-8e3f-950b457426b6', None, None, None, None, None)] {{(pid=117670) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 30 12:23:02.708052 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-eee508b8-5725-4ccd-9232-dc85adb0aa50 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Flavor limits 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 30 12:23:02.708512 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-eee508b8-5725-4ccd-9232-dc85adb0aa50 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Image limits 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 30 12:23:02.708989 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-eee508b8-5725-4ccd-9232-dc85adb0aa50 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Flavor pref 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 30 12:23:02.709403 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-eee508b8-5725-4ccd-9232-dc85adb0aa50 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Image pref 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 30 12:23:02.709819 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-eee508b8-5725-4ccd-9232-dc85adb0aa50 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 30 12:23:02.719266 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-eee508b8-5725-4ccd-9232-dc85adb0aa50 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:23:02.719716 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-eee508b8-5725-4ccd-9232-dc85adb0aa50 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:23:02.720560 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-eee508b8-5725-4ccd-9232-dc85adb0aa50 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:23:02.720998 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-eee508b8-5725-4ccd-9232-dc85adb0aa50 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:23:02.738853 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.quota [None req-eee508b8-5725-4ccd-9232-dc85adb0aa50 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Getting quotas for project 5143c400e4544c79955f901394c449f6. Resources: {'cores', 'instances', 'ram'} {{(pid=117670) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 30 12:23:02.742867 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.quota [None req-eee508b8-5725-4ccd-9232-dc85adb0aa50 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Getting quotas for user 923af8dc0f1d4779bf388151093311f6 and project 5143c400e4544c79955f901394c449f6. Resources: {'cores', 'instances', 'ram'} {{(pid=117670) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 30 12:23:02.812670 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-eee508b8-5725-4ccd-9232-dc85adb0aa50 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Going to run 1 instances... {{(pid=117670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 30 12:23:02.814787 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-eee508b8-5725-4ccd-9232-dc85adb0aa50 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] [instance: de66dc75-391a-4041-83d2-e818da5f82b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4fa582a2-fd20-4e15-939a-da29cd6d8b26',volume_size=None,volume_type=None)] {{(pid=117670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 30 12:23:02.946342 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-eee508b8-5725-4ccd-9232-dc85adb0aa50 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.728528 May 30 12:23:02.946993 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 517/1044] 10.222.0.32 () {60 vars in 1146 bytes} [Mon May 30 12:23:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 30 12:23:02.959450 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-352485a5-c669-431e-8f2d-9845f13257ea tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:23:02.960213 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-352485a5-c669-431e-8f2d-9845f13257ea tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] [instance: de66dc75-391a-4041-83d2-e818da5f82b9] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:23:02.963378 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_api:SELECT=28 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:23:02.964533 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell1:SELECT=60 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:23:03.025283 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-352485a5-c669-431e-8f2d-9845f13257ea tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923af8dc0f1d4779bf388151093311f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143c400e4544c79955f901394c449f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:23:03.032534 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-352485a5-c669-431e-8f2d-9845f13257ea tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] 10.222.0.32 "GET /compute/v2.1/servers/de66dc75-391a-4041-83d2-e818da5f82b9" status: 200 len: 1095 microversion: 2.1 time: 0.078050 May 30 12:23:03.033110 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 528/1045] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:23:02 2022] GET /compute/v2.1/servers/de66dc75-391a-4041-83d2-e818da5f82b9 => generated 1095 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:23:04.050291 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-3fe63267-301e-43f5-a5de-7589e9b5fda6 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:23:04.051164 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-3fe63267-301e-43f5-a5de-7589e9b5fda6 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] [instance: de66dc75-391a-4041-83d2-e818da5f82b9] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:23:04.053806 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a7a082e1-c3c0-4ddb-81e3-672e5371c0f7] AMQP server on 10.222.0.32:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 30 12:23:04.060948 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3fe63267-301e-43f5-a5de-7589e9b5fda6 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:23:04.061575 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3fe63267-301e-43f5-a5de-7589e9b5fda6 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:23:04.062367 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3fe63267-301e-43f5-a5de-7589e9b5fda6 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:23:04.062993 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3fe63267-301e-43f5-a5de-7589e9b5fda6 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:23:04.127559 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-3fe63267-301e-43f5-a5de-7589e9b5fda6 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923af8dc0f1d4779bf388151093311f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143c400e4544c79955f901394c449f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:23:04.135547 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-3fe63267-301e-43f5-a5de-7589e9b5fda6 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] 10.222.0.32 "GET /compute/v2.1/servers/de66dc75-391a-4041-83d2-e818da5f82b9" status: 200 len: 1201 microversion: 2.1 time: 0.089194 May 30 12:23:04.136553 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 518/1046] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:23:04 2022] GET /compute/v2.1/servers/de66dc75-391a-4041-83d2-e818da5f82b9 => generated 1201 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:23:05.154887 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-8aeea518-65d4-4890-9a2a-85fff0989802 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:23:05.155864 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-8aeea518-65d4-4890-9a2a-85fff0989802 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] [instance: de66dc75-391a-4041-83d2-e818da5f82b9] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:23:05.163428 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8aeea518-65d4-4890-9a2a-85fff0989802 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:23:05.163956 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8aeea518-65d4-4890-9a2a-85fff0989802 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:23:05.164863 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8aeea518-65d4-4890-9a2a-85fff0989802 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:23:05.165373 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8aeea518-65d4-4890-9a2a-85fff0989802 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:23:05.307702 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-8aeea518-65d4-4890-9a2a-85fff0989802 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923af8dc0f1d4779bf388151093311f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143c400e4544c79955f901394c449f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:23:05.317037 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-8aeea518-65d4-4890-9a2a-85fff0989802 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] 10.222.0.32 "GET /compute/v2.1/servers/de66dc75-391a-4041-83d2-e818da5f82b9" status: 200 len: 1267 microversion: 2.1 time: 0.166588 May 30 12:23:05.327693 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 529/1047] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:23:05 2022] GET /compute/v2.1/servers/de66dc75-391a-4041-83d2-e818da5f82b9 => generated 1267 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:23:05.471540 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO oslo.messaging._drivers.impl_rabbit [-] [a7a082e1-c3c0-4ddb-81e3-672e5371c0f7] Reconnected to AMQP server on 10.222.0.32:5672 via [amqp] client with port 59042. May 30 12:23:05.537387 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-7cf1228c-a5ad-4854-b9ce-4c8b978ed156 req-aa7864b5-8c43-4445-b5c1-95a4f3d7f531 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de66dc75-391a-4041-83d2-e818da5f82b9", "tag": "188cadae-a218-4f4b-98f1-dceacd61dc9d"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:23:05.546915 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-7cf1228c-a5ad-4854-b9ce-4c8b978ed156 req-aa7864b5-8c43-4445-b5c1-95a4f3d7f531 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:23:05.548081 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-7cf1228c-a5ad-4854-b9ce-4c8b978ed156 req-aa7864b5-8c43-4445-b5c1-95a4f3d7f531 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:23:05.562066 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-7cf1228c-a5ad-4854-b9ce-4c8b978ed156 req-aa7864b5-8c43-4445-b5c1-95a4f3d7f531 service nova] Creating event network-changed:188cadae-a218-4f4b-98f1-dceacd61dc9d for instance de66dc75-391a-4041-83d2-e818da5f82b9 on hv-cinder-84051 May 30 12:23:05.567297 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-7cf1228c-a5ad-4854-b9ce-4c8b978ed156 req-aa7864b5-8c43-4445-b5c1-95a4f3d7f531 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110237 May 30 12:23:05.567923 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 519/1048] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:23:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:23:06.334636 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-de2bc477-a12f-429b-b61e-8a872f1f211c tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:23:06.335244 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-de2bc477-a12f-429b-b61e-8a872f1f211c tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] [instance: de66dc75-391a-4041-83d2-e818da5f82b9] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:23:06.342553 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-de2bc477-a12f-429b-b61e-8a872f1f211c tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:23:06.343198 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-de2bc477-a12f-429b-b61e-8a872f1f211c tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:23:06.343970 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-de2bc477-a12f-429b-b61e-8a872f1f211c tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:23:06.344432 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-de2bc477-a12f-429b-b61e-8a872f1f211c tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:23:06.481177 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-de2bc477-a12f-429b-b61e-8a872f1f211c tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923af8dc0f1d4779bf388151093311f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143c400e4544c79955f901394c449f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:23:06.489766 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-de2bc477-a12f-429b-b61e-8a872f1f211c tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] 10.222.0.32 "GET /compute/v2.1/servers/de66dc75-391a-4041-83d2-e818da5f82b9" status: 200 len: 1267 microversion: 2.1 time: 0.158894 May 30 12:23:06.490374 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 530/1049] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:23:06 2022] GET /compute/v2.1/servers/de66dc75-391a-4041-83d2-e818da5f82b9 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:23:07.507584 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-e4efb1f1-43ad-4a6a-8992-094d3548ee17 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:23:07.508315 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-e4efb1f1-43ad-4a6a-8992-094d3548ee17 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] [instance: de66dc75-391a-4041-83d2-e818da5f82b9] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:23:07.515343 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e4efb1f1-43ad-4a6a-8992-094d3548ee17 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:23:07.515795 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e4efb1f1-43ad-4a6a-8992-094d3548ee17 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:23:07.516596 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e4efb1f1-43ad-4a6a-8992-094d3548ee17 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:23:07.517040 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e4efb1f1-43ad-4a6a-8992-094d3548ee17 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:23:07.648721 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-e4efb1f1-43ad-4a6a-8992-094d3548ee17 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923af8dc0f1d4779bf388151093311f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143c400e4544c79955f901394c449f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:23:07.656849 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-e4efb1f1-43ad-4a6a-8992-094d3548ee17 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] 10.222.0.32 "GET /compute/v2.1/servers/de66dc75-391a-4041-83d2-e818da5f82b9" status: 200 len: 1267 microversion: 2.1 time: 0.153974 May 30 12:23:07.657618 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 520/1050] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:23:07 2022] GET /compute/v2.1/servers/de66dc75-391a-4041-83d2-e818da5f82b9 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:23:08.673866 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-f0be3e35-a179-43c2-8bd1-67c3a4ec5119 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:23:08.674402 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-f0be3e35-a179-43c2-8bd1-67c3a4ec5119 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] [instance: de66dc75-391a-4041-83d2-e818da5f82b9] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:23:08.680825 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f0be3e35-a179-43c2-8bd1-67c3a4ec5119 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:23:08.681264 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f0be3e35-a179-43c2-8bd1-67c3a4ec5119 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:23:08.682049 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f0be3e35-a179-43c2-8bd1-67c3a4ec5119 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:23:08.682475 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f0be3e35-a179-43c2-8bd1-67c3a4ec5119 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:23:08.818162 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-f0be3e35-a179-43c2-8bd1-67c3a4ec5119 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923af8dc0f1d4779bf388151093311f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143c400e4544c79955f901394c449f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:23:08.826354 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-f0be3e35-a179-43c2-8bd1-67c3a4ec5119 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] 10.222.0.32 "GET /compute/v2.1/servers/de66dc75-391a-4041-83d2-e818da5f82b9" status: 200 len: 1267 microversion: 2.1 time: 0.156213 May 30 12:23:08.826920 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 531/1051] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:23:08 2022] GET /compute/v2.1/servers/de66dc75-391a-4041-83d2-e818da5f82b9 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:23:09.843039 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-7e4b463b-7e37-4c12-9ebc-6ac09b2bb021 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:23:09.843607 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-7e4b463b-7e37-4c12-9ebc-6ac09b2bb021 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] [instance: de66dc75-391a-4041-83d2-e818da5f82b9] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:23:09.851427 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7e4b463b-7e37-4c12-9ebc-6ac09b2bb021 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:23:09.851884 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7e4b463b-7e37-4c12-9ebc-6ac09b2bb021 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:23:09.853051 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7e4b463b-7e37-4c12-9ebc-6ac09b2bb021 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:23:09.853823 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7e4b463b-7e37-4c12-9ebc-6ac09b2bb021 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:23:09.989370 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-7e4b463b-7e37-4c12-9ebc-6ac09b2bb021 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923af8dc0f1d4779bf388151093311f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143c400e4544c79955f901394c449f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:23:09.997019 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-7e4b463b-7e37-4c12-9ebc-6ac09b2bb021 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] 10.222.0.32 "GET /compute/v2.1/servers/de66dc75-391a-4041-83d2-e818da5f82b9" status: 200 len: 1267 microversion: 2.1 time: 0.157931 May 30 12:23:09.997590 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 521/1052] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:23:09 2022] GET /compute/v2.1/servers/de66dc75-391a-4041-83d2-e818da5f82b9 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:23:11.014569 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-b0153af7-7a49-4c08-aab6-7a15ae73f8fb tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:23:11.015227 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-b0153af7-7a49-4c08-aab6-7a15ae73f8fb tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] [instance: de66dc75-391a-4041-83d2-e818da5f82b9] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:23:11.021722 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b0153af7-7a49-4c08-aab6-7a15ae73f8fb tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:23:11.022174 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b0153af7-7a49-4c08-aab6-7a15ae73f8fb tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:23:11.022946 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b0153af7-7a49-4c08-aab6-7a15ae73f8fb tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:23:11.023386 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b0153af7-7a49-4c08-aab6-7a15ae73f8fb tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:23:11.160040 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-b0153af7-7a49-4c08-aab6-7a15ae73f8fb tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923af8dc0f1d4779bf388151093311f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143c400e4544c79955f901394c449f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:23:11.167423 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-b0153af7-7a49-4c08-aab6-7a15ae73f8fb tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] 10.222.0.32 "GET /compute/v2.1/servers/de66dc75-391a-4041-83d2-e818da5f82b9" status: 200 len: 1267 microversion: 2.1 time: 0.156714 May 30 12:23:11.168003 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 532/1053] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:23:11 2022] GET /compute/v2.1/servers/de66dc75-391a-4041-83d2-e818da5f82b9 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:23:12.184531 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-14d0b604-387f-432a-bf74-a51704bf898f tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:23:12.185126 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-14d0b604-387f-432a-bf74-a51704bf898f tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] [instance: de66dc75-391a-4041-83d2-e818da5f82b9] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:23:12.192015 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-14d0b604-387f-432a-bf74-a51704bf898f tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:23:12.192487 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-14d0b604-387f-432a-bf74-a51704bf898f tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:23:12.193242 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-14d0b604-387f-432a-bf74-a51704bf898f tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:23:12.193671 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-14d0b604-387f-432a-bf74-a51704bf898f tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:23:12.325886 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-14d0b604-387f-432a-bf74-a51704bf898f tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923af8dc0f1d4779bf388151093311f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143c400e4544c79955f901394c449f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:23:12.334498 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-14d0b604-387f-432a-bf74-a51704bf898f tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] 10.222.0.32 "GET /compute/v2.1/servers/de66dc75-391a-4041-83d2-e818da5f82b9" status: 200 len: 1267 microversion: 2.1 time: 0.153777 May 30 12:23:12.335066 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 522/1054] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:23:12 2022] GET /compute/v2.1/servers/de66dc75-391a-4041-83d2-e818da5f82b9 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:23:13.352959 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-7d90fea2-1cac-4e17-b0d5-9397e5b52cdf tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:23:13.353577 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-7d90fea2-1cac-4e17-b0d5-9397e5b52cdf tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] [instance: de66dc75-391a-4041-83d2-e818da5f82b9] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:23:13.356000 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell0:SELECT=2 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:23:13.362404 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7d90fea2-1cac-4e17-b0d5-9397e5b52cdf tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:23:13.362854 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7d90fea2-1cac-4e17-b0d5-9397e5b52cdf tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:23:13.363632 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7d90fea2-1cac-4e17-b0d5-9397e5b52cdf tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:23:13.364067 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7d90fea2-1cac-4e17-b0d5-9397e5b52cdf tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:23:13.498790 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-7d90fea2-1cac-4e17-b0d5-9397e5b52cdf tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923af8dc0f1d4779bf388151093311f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143c400e4544c79955f901394c449f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:23:13.506711 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-7d90fea2-1cac-4e17-b0d5-9397e5b52cdf tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] 10.222.0.32 "GET /compute/v2.1/servers/de66dc75-391a-4041-83d2-e818da5f82b9" status: 200 len: 1267 microversion: 2.1 time: 0.157681 May 30 12:23:13.507357 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 533/1055] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:23:13 2022] GET /compute/v2.1/servers/de66dc75-391a-4041-83d2-e818da5f82b9 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:23:14.524269 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-79c12b32-47eb-479b-87e2-f6909368f4a2 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:23:14.525170 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-79c12b32-47eb-479b-87e2-f6909368f4a2 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] [instance: de66dc75-391a-4041-83d2-e818da5f82b9] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:23:14.527695 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell0:SELECT=2 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:23:14.528397 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell0:SELECT=6 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:23:14.535324 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-79c12b32-47eb-479b-87e2-f6909368f4a2 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:23:14.535775 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-79c12b32-47eb-479b-87e2-f6909368f4a2 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:23:14.536646 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-79c12b32-47eb-479b-87e2-f6909368f4a2 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:23:14.537084 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-79c12b32-47eb-479b-87e2-f6909368f4a2 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:23:14.672953 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-79c12b32-47eb-479b-87e2-f6909368f4a2 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923af8dc0f1d4779bf388151093311f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143c400e4544c79955f901394c449f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:23:14.682061 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-79c12b32-47eb-479b-87e2-f6909368f4a2 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] 10.222.0.32 "GET /compute/v2.1/servers/de66dc75-391a-4041-83d2-e818da5f82b9" status: 200 len: 1267 microversion: 2.1 time: 0.161725 May 30 12:23:14.683041 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 523/1056] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:23:14 2022] GET /compute/v2.1/servers/de66dc75-391a-4041-83d2-e818da5f82b9 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:23:15.699416 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-942e9b2a-eab6-4c7d-9b51-47ec4dc97d5d tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:23:15.700022 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-942e9b2a-eab6-4c7d-9b51-47ec4dc97d5d tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] [instance: de66dc75-391a-4041-83d2-e818da5f82b9] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:23:15.706925 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-942e9b2a-eab6-4c7d-9b51-47ec4dc97d5d tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:23:15.707377 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-942e9b2a-eab6-4c7d-9b51-47ec4dc97d5d tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:23:15.708339 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-942e9b2a-eab6-4c7d-9b51-47ec4dc97d5d tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:23:15.708840 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-942e9b2a-eab6-4c7d-9b51-47ec4dc97d5d tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:23:15.853897 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-942e9b2a-eab6-4c7d-9b51-47ec4dc97d5d tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923af8dc0f1d4779bf388151093311f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143c400e4544c79955f901394c449f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:23:15.861585 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-942e9b2a-eab6-4c7d-9b51-47ec4dc97d5d tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] 10.222.0.32 "GET /compute/v2.1/servers/de66dc75-391a-4041-83d2-e818da5f82b9" status: 200 len: 1267 microversion: 2.1 time: 0.166018 May 30 12:23:15.862144 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 534/1057] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:23:15 2022] GET /compute/v2.1/servers/de66dc75-391a-4041-83d2-e818da5f82b9 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:23:16.880218 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-b7cd1431-6e99-4006-ba2a-a0c0ce472de8 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:23:16.881502 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-b7cd1431-6e99-4006-ba2a-a0c0ce472de8 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] [instance: de66dc75-391a-4041-83d2-e818da5f82b9] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:23:16.882125 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-14ea84aa-5ce9-43ce-827b-5a38b5375916 req-ddb696e7-1195-4667-bcb3-95864fe8665b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de66dc75-391a-4041-83d2-e818da5f82b9", "name": "network-vif-plugged", "status": "completed", "tag": "188cadae-a218-4f4b-98f1-dceacd61dc9d"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:23:16.889242 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b7cd1431-6e99-4006-ba2a-a0c0ce472de8 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:23:16.889705 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b7cd1431-6e99-4006-ba2a-a0c0ce472de8 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:23:16.890698 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-14ea84aa-5ce9-43ce-827b-5a38b5375916 req-ddb696e7-1195-4667-bcb3-95864fe8665b service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:23:16.891018 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b7cd1431-6e99-4006-ba2a-a0c0ce472de8 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:23:16.891138 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-14ea84aa-5ce9-43ce-827b-5a38b5375916 req-ddb696e7-1195-4667-bcb3-95864fe8665b service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:23:16.891795 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b7cd1431-6e99-4006-ba2a-a0c0ce472de8 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:23:16.903153 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-14ea84aa-5ce9-43ce-827b-5a38b5375916 req-ddb696e7-1195-4667-bcb3-95864fe8665b service nova] Creating event network-vif-plugged:188cadae-a218-4f4b-98f1-dceacd61dc9d for instance de66dc75-391a-4041-83d2-e818da5f82b9 on hv-cinder-84051 May 30 12:23:16.908905 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-14ea84aa-5ce9-43ce-827b-5a38b5375916 req-ddb696e7-1195-4667-bcb3-95864fe8665b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089739 May 30 12:23:16.909589 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 524/1058] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:23:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:23:17.029702 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-b7cd1431-6e99-4006-ba2a-a0c0ce472de8 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923af8dc0f1d4779bf388151093311f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143c400e4544c79955f901394c449f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:23:17.038427 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-b7cd1431-6e99-4006-ba2a-a0c0ce472de8 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] 10.222.0.32 "GET /compute/v2.1/servers/de66dc75-391a-4041-83d2-e818da5f82b9" status: 200 len: 1267 microversion: 2.1 time: 0.164016 May 30 12:23:17.039319 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 535/1059] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:23:16 2022] GET /compute/v2.1/servers/de66dc75-391a-4041-83d2-e818da5f82b9 => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:23:18.057836 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-b39efa4e-f9ea-4253-9f4d-e2106b707f38 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:23:18.058603 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-b39efa4e-f9ea-4253-9f4d-e2106b707f38 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] [instance: de66dc75-391a-4041-83d2-e818da5f82b9] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:23:18.065775 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b39efa4e-f9ea-4253-9f4d-e2106b707f38 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:23:18.066228 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b39efa4e-f9ea-4253-9f4d-e2106b707f38 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:23:18.067023 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b39efa4e-f9ea-4253-9f4d-e2106b707f38 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:23:18.067460 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b39efa4e-f9ea-4253-9f4d-e2106b707f38 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:23:18.204764 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-b39efa4e-f9ea-4253-9f4d-e2106b707f38 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923af8dc0f1d4779bf388151093311f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143c400e4544c79955f901394c449f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:23:18.212442 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-b39efa4e-f9ea-4253-9f4d-e2106b707f38 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] 10.222.0.32 "GET /compute/v2.1/servers/de66dc75-391a-4041-83d2-e818da5f82b9" status: 200 len: 1267 microversion: 2.1 time: 0.159349 May 30 12:23:18.213020 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 525/1060] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:23:18 2022] GET /compute/v2.1/servers/de66dc75-391a-4041-83d2-e818da5f82b9 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:23:19.229053 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-ddc21674-da73-4180-ac34-087848cebd45 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:23:19.229698 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-ddc21674-da73-4180-ac34-087848cebd45 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] [instance: de66dc75-391a-4041-83d2-e818da5f82b9] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:23:19.236446 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ddc21674-da73-4180-ac34-087848cebd45 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:23:19.236907 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ddc21674-da73-4180-ac34-087848cebd45 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:23:19.237682 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ddc21674-da73-4180-ac34-087848cebd45 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:23:19.238120 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ddc21674-da73-4180-ac34-087848cebd45 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:23:19.367704 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-ddc21674-da73-4180-ac34-087848cebd45 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923af8dc0f1d4779bf388151093311f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143c400e4544c79955f901394c449f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:23:19.375326 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-ddc21674-da73-4180-ac34-087848cebd45 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] 10.222.0.32 "GET /compute/v2.1/servers/de66dc75-391a-4041-83d2-e818da5f82b9" status: 200 len: 1454 microversion: 2.1 time: 0.150136 May 30 12:23:19.375891 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 536/1061] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:23:19 2022] GET /compute/v2.1/servers/de66dc75-391a-4041-83d2-e818da5f82b9 => generated 1454 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:23:19.393077 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-941796d3-43d1-4e90-9b82-e040224ecca7 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:23:19.393699 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-941796d3-43d1-4e90-9b82-e040224ecca7 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] [instance: de66dc75-391a-4041-83d2-e818da5f82b9] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:23:19.400141 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-941796d3-43d1-4e90-9b82-e040224ecca7 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:23:19.400696 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-941796d3-43d1-4e90-9b82-e040224ecca7 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:23:19.401464 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-941796d3-43d1-4e90-9b82-e040224ecca7 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:23:19.402157 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-941796d3-43d1-4e90-9b82-e040224ecca7 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:23:19.534771 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-941796d3-43d1-4e90-9b82-e040224ecca7 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923af8dc0f1d4779bf388151093311f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143c400e4544c79955f901394c449f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:23:19.542730 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-941796d3-43d1-4e90-9b82-e040224ecca7 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] 10.222.0.32 "GET /compute/v2.1/servers/de66dc75-391a-4041-83d2-e818da5f82b9" status: 200 len: 1454 microversion: 2.1 time: 0.154243 May 30 12:23:19.543291 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 526/1062] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:23:19 2022] GET /compute/v2.1/servers/de66dc75-391a-4041-83d2-e818da5f82b9 => generated 1454 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:23:21.529265 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-eee3b0f3-57e5-4257-994f-3eeb7d8cf296 req-10188ebc-c952-4ffd-b3ba-cc99e04669b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de66dc75-391a-4041-83d2-e818da5f82b9", "tag": "188cadae-a218-4f4b-98f1-dceacd61dc9d"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:23:21.537797 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-eee3b0f3-57e5-4257-994f-3eeb7d8cf296 req-10188ebc-c952-4ffd-b3ba-cc99e04669b7 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:23:21.538364 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-eee3b0f3-57e5-4257-994f-3eeb7d8cf296 req-10188ebc-c952-4ffd-b3ba-cc99e04669b7 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:23:21.549484 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-eee3b0f3-57e5-4257-994f-3eeb7d8cf296 req-10188ebc-c952-4ffd-b3ba-cc99e04669b7 service nova] Creating event network-changed:188cadae-a218-4f4b-98f1-dceacd61dc9d for instance de66dc75-391a-4041-83d2-e818da5f82b9 on hv-cinder-84051 May 30 12:23:21.554618 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-eee3b0f3-57e5-4257-994f-3eeb7d8cf296 req-10188ebc-c952-4ffd-b3ba-cc99e04669b7 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089997 May 30 12:23:21.555212 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 537/1063] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:23:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:24:09.844454 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 30 12:24:09.845049 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Mon May 30 12:24:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 30 12:24:11.680744 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 30 12:24:11.681244 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Mon May 30 12:24:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 30 12:24:25.505442 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 30 12:24:25.506130 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Mon May 30 12:24:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 30 12:25:01.705918 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:25:01.707540 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell1:SELECT=48 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:25:01.709254 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_api:SELECT=22 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:25:01.710569 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell1:SELECT=50 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:25:01.712818 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-66aef869-95f9-465d-a58d-45b5c72b4096 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:25:01.713658 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-66aef869-95f9-465d-a58d-45b5c72b4096 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] [instance: de66dc75-391a-4041-83d2-e818da5f82b9] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:25:01.714852 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-eef55882-0a93-4bcd-afda-af48a154aeb8 req-3299080b-ac28-4bc8-a7b6-54f808b78a0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de66dc75-391a-4041-83d2-e818da5f82b9", "tag": "188cadae-a218-4f4b-98f1-dceacd61dc9d"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:25:01.721699 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-66aef869-95f9-465d-a58d-45b5c72b4096 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:25:01.722259 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-66aef869-95f9-465d-a58d-45b5c72b4096 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:25:01.723278 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-66aef869-95f9-465d-a58d-45b5c72b4096 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:25:01.723757 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-66aef869-95f9-465d-a58d-45b5c72b4096 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:25:01.728233 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-eef55882-0a93-4bcd-afda-af48a154aeb8 req-3299080b-ac28-4bc8-a7b6-54f808b78a0a service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:25:01.728951 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-eef55882-0a93-4bcd-afda-af48a154aeb8 req-3299080b-ac28-4bc8-a7b6-54f808b78a0a service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:25:01.739658 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-eef55882-0a93-4bcd-afda-af48a154aeb8 req-3299080b-ac28-4bc8-a7b6-54f808b78a0a service nova] Creating event network-changed:188cadae-a218-4f4b-98f1-dceacd61dc9d for instance de66dc75-391a-4041-83d2-e818da5f82b9 on hv-cinder-84051 May 30 12:25:01.746076 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-eef55882-0a93-4bcd-afda-af48a154aeb8 req-3299080b-ac28-4bc8-a7b6-54f808b78a0a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039181 May 30 12:25:01.746984 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 538/1064] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:25:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 30 12:25:01.753663 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-66aef869-95f9-465d-a58d-45b5c72b4096 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] [instance: de66dc75-391a-4041-83d2-e818da5f82b9] Going to try to terminate instance {{(pid=117670) delete /opt/stack/nova/nova/compute/api.py:2664}} May 30 12:25:01.849326 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-66aef869-95f9-465d-a58d-45b5c72b4096 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] 10.222.0.32 "DELETE /compute/v2.1/servers/de66dc75-391a-4041-83d2-e818da5f82b9" status: 204 len: 0 microversion: 2.1 time: 0.145259 May 30 12:25:01.852367 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 527/1065] 10.222.0.32 () {58 vars in 1238 bytes} [Mon May 30 12:25:01 2022] DELETE /compute/v2.1/servers/de66dc75-391a-4041-83d2-e818da5f82b9 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 30 12:25:01.863308 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-84a934af-5f32-4c83-acd6-b0a431ff2091 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:25:01.864529 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-84a934af-5f32-4c83-acd6-b0a431ff2091 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] [instance: de66dc75-391a-4041-83d2-e818da5f82b9] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:25:01.880438 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-84a934af-5f32-4c83-acd6-b0a431ff2091 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:25:01.882048 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-84a934af-5f32-4c83-acd6-b0a431ff2091 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:25:01.883361 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-84a934af-5f32-4c83-acd6-b0a431ff2091 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:25:01.884051 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-84a934af-5f32-4c83-acd6-b0a431ff2091 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:25:02.026412 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-84a934af-5f32-4c83-acd6-b0a431ff2091 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923af8dc0f1d4779bf388151093311f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143c400e4544c79955f901394c449f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:25:02.034482 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-84a934af-5f32-4c83-acd6-b0a431ff2091 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] 10.222.0.32 "GET /compute/v2.1/servers/de66dc75-391a-4041-83d2-e818da5f82b9" status: 200 len: 1578 microversion: 2.1 time: 0.177375 May 30 12:25:02.035060 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 539/1066] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:25:01 2022] GET /compute/v2.1/servers/de66dc75-391a-4041-83d2-e818da5f82b9 => generated 1578 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:25:03.053075 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-4988c363-29ee-4dcb-864e-2759b9f1a8b9 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:25:03.053720 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-4988c363-29ee-4dcb-864e-2759b9f1a8b9 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] [instance: de66dc75-391a-4041-83d2-e818da5f82b9] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:25:03.060480 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4988c363-29ee-4dcb-864e-2759b9f1a8b9 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:25:03.061026 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4988c363-29ee-4dcb-864e-2759b9f1a8b9 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:25:03.061725 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4988c363-29ee-4dcb-864e-2759b9f1a8b9 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:25:03.062156 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4988c363-29ee-4dcb-864e-2759b9f1a8b9 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:25:03.212072 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-4988c363-29ee-4dcb-864e-2759b9f1a8b9 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923af8dc0f1d4779bf388151093311f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143c400e4544c79955f901394c449f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:25:03.219647 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-4988c363-29ee-4dcb-864e-2759b9f1a8b9 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] 10.222.0.32 "GET /compute/v2.1/servers/de66dc75-391a-4041-83d2-e818da5f82b9" status: 200 len: 1578 microversion: 2.1 time: 0.171002 May 30 12:25:03.220239 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 528/1067] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:25:03 2022] GET /compute/v2.1/servers/de66dc75-391a-4041-83d2-e818da5f82b9 => generated 1578 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:25:04.146923 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-946ceff9-f215-4aa4-bb18-1eeec3e93e1c req-9e82a1a8-e755-49c0-80cd-7deeec5722f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de66dc75-391a-4041-83d2-e818da5f82b9", "name": "network-vif-deleted", "tag": "188cadae-a218-4f4b-98f1-dceacd61dc9d"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:25:04.157255 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-946ceff9-f215-4aa4-bb18-1eeec3e93e1c req-9e82a1a8-e755-49c0-80cd-7deeec5722f6 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:25:04.157619 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-946ceff9-f215-4aa4-bb18-1eeec3e93e1c req-9e82a1a8-e755-49c0-80cd-7deeec5722f6 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:25:04.171241 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-946ceff9-f215-4aa4-bb18-1eeec3e93e1c req-9e82a1a8-e755-49c0-80cd-7deeec5722f6 service nova] Creating event network-vif-deleted:188cadae-a218-4f4b-98f1-dceacd61dc9d for instance de66dc75-391a-4041-83d2-e818da5f82b9 on hv-cinder-84051 May 30 12:25:04.176993 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-946ceff9-f215-4aa4-bb18-1eeec3e93e1c req-9e82a1a8-e755-49c0-80cd-7deeec5722f6 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034324 May 30 12:25:04.178279 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 540/1068] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:25:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:25:04.236891 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-c2383a82-590e-445f-b2da-e65782672490 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:25:04.237582 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-c2383a82-590e-445f-b2da-e65782672490 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] [instance: de66dc75-391a-4041-83d2-e818da5f82b9] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:25:04.244473 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c2383a82-590e-445f-b2da-e65782672490 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:25:04.244926 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c2383a82-590e-445f-b2da-e65782672490 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:25:04.245697 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c2383a82-590e-445f-b2da-e65782672490 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:25:04.246137 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c2383a82-590e-445f-b2da-e65782672490 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:25:04.309161 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-c2383a82-590e-445f-b2da-e65782672490 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923af8dc0f1d4779bf388151093311f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143c400e4544c79955f901394c449f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:25:04.316770 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-c2383a82-590e-445f-b2da-e65782672490 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] 10.222.0.32 "GET /compute/v2.1/servers/de66dc75-391a-4041-83d2-e818da5f82b9" status: 200 len: 1226 microversion: 2.1 time: 0.083698 May 30 12:25:04.317316 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 529/1069] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:25:04 2022] GET /compute/v2.1/servers/de66dc75-391a-4041-83d2-e818da5f82b9 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:25:05.333884 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-8b96bc43-f08c-444d-8f7e-cbca7fca2060 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:25:05.334628 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-8b96bc43-f08c-444d-8f7e-cbca7fca2060 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] [instance: de66dc75-391a-4041-83d2-e818da5f82b9] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:25:05.340909 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8b96bc43-f08c-444d-8f7e-cbca7fca2060 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:25:05.341353 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8b96bc43-f08c-444d-8f7e-cbca7fca2060 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:25:05.342119 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8b96bc43-f08c-444d-8f7e-cbca7fca2060 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:25:05.342549 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8b96bc43-f08c-444d-8f7e-cbca7fca2060 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:25:05.355937 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.wsgi [None req-8b96bc43-f08c-444d-8f7e-cbca7fca2060 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] HTTP exception thrown: Instance de66dc75-391a-4041-83d2-e818da5f82b9 could not be found. May 30 12:25:05.357567 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-8b96bc43-f08c-444d-8f7e-cbca7fca2060 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Request method failure captured: May 30 12:25:05.357567 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: request: GET /compute/v2.1/servers/de66dc75-391a-4041-83d2-e818da5f82b9 HTTP/1.1 May 30 12:25:05.357567 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Accept: application/json May 30 12:25:05.357567 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Accept-Encoding: identity May 30 12:25:05.357567 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Connection: close May 30 12:25:05.357567 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Content-Length: 0 May 30 12:25:05.357567 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Content-Type: application/json May 30 12:25:05.357567 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Host: 10.222.0.32 May 30 12:25:05.357567 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Openstack-System-Scope: None May 30 12:25:05.357567 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: User-Agent: python-urllib3/1.26.9 May 30 12:25:05.357567 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Auth-Token: gAAAAABilLYJ8yD9zjHsgwVNhwmlOc84aR0-ls_eOuOFz5m7ew82a65Im6Z5tPXeZEvIgPz3JSvQMJIX4Ds_E74k3HnvajayX0QYGJEXNA8CQ6dAp-eAWEOPynREKg7GvzXvPpjW-8GWPRYhWLBp871ZPukmRxEicEgMhPRbwUt9L1aDIsLcjZY May 30 12:25:05.357567 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Domain-Id: None May 30 12:25:05.357567 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Domain-Name: None May 30 12:25:05.357567 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Identity-Status: Confirmed May 30 12:25:05.357567 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Is-Admin-Project: True May 30 12:25:05.357567 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Domain-Id: default May 30 12:25:05.357567 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Domain-Name: Default May 30 12:25:05.357567 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Id: 5143c400e4544c79955f901394c449f6 May 30 12:25:05.357567 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Name: tempest-TestVolumeBootPattern-1287587269 May 30 12:25:05.357567 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Role: reader,member May 30 12:25:05.357567 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Roles: reader,member May 30 12:25:05.359328 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/5143c400e4544c79955f901394c449f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/5143c400e4544c79955f901394c449f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/5143c400e4544c79955f901394c449f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_5143c400e4544c79955f901394c449f6", "adminURL": "http://10.222.0.32:8080"}]}] May 30 12:25:05.359328 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Tenant: tempest-TestVolumeBootPattern-1287587269 May 30 12:25:05.359328 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Tenant-Id: 5143c400e4544c79955f901394c449f6 May 30 12:25:05.359328 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Tenant-Name: tempest-TestVolumeBootPattern-1287587269 May 30 12:25:05.359328 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User: tempest-TestVolumeBootPattern-1287587269-project May 30 12:25:05.359328 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Domain-Id: default May 30 12:25:05.359328 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Domain-Name: Default May 30 12:25:05.359328 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Id: 923af8dc0f1d4779bf388151093311f6 May 30 12:25:05.359328 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Name: tempest-TestVolumeBootPattern-1287587269-project May 30 12:25:05.359328 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: method: > May 30 12:25:05.359328 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: exception: Instance de66dc75-391a-4041-83d2-e818da5f82b9 could not be found. May 30 12:25:05.359328 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: action_args: {'id': 'de66dc75-391a-4041-83d2-e818da5f82b9'} May 30 12:25:05.360432 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:25:05.360432 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:25:05.360432 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:25:05.360432 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:25:05.360432 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:25:05.360432 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:25:05.360432 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:25:05.360432 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:25:05.360432 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:25:05.360432 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:25:05.360432 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de66dc75-391a-4041-83d2-e818da5f82b9 could not be found. May 30 12:25:05.360432 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:25:05.360432 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:25:05.360432 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:25:05.360432 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:25:05.360432 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:25:05.360432 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:25:05.360432 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:25:05.360432 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:25:05.360432 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:25:05.361858 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:25:05.361858 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 30 12:25:05.361858 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 30 12:25:05.361858 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 30 12:25:05.361858 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 30 12:25:05.361858 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:25:05.361858 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:25:05.361858 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de66dc75-391a-4041-83d2-e818da5f82b9 could not be found. May 30 12:25:05.361858 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:25:05.361858 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:25:05.361858 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:25:05.361858 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:25:05.361858 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:25:05.361858 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:25:05.361858 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:25:05.361858 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:25:05.361858 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de66dc75-391a-4041-83d2-e818da5f82b9 could not be found. May 30 12:25:05.361858 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:25:05.363199 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-8b96bc43-f08c-444d-8f7e-cbca7fca2060 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Returning 404 to user: Instance de66dc75-391a-4041-83d2-e818da5f82b9 could not be found. {{(pid=117671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:25:05.363199 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-8b96bc43-f08c-444d-8f7e-cbca7fca2060 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] 10.222.0.32 "GET /compute/v2.1/servers/de66dc75-391a-4041-83d2-e818da5f82b9" status: 404 len: 111 microversion: 2.1 time: 0.029279 May 30 12:25:05.363199 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 541/1070] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:25:05 2022] GET /compute/v2.1/servers/de66dc75-391a-4041-83d2-e818da5f82b9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 30 12:25:08.449227 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-8c2bec57-25ff-4973-86c6-26e0d873060c req-567d1394-e62e-450b-a8ce-b51ad5261c9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6063ef32-6212-4feb-b3f1-4ec57a283a85", "tag": "d462e5dd-3dc2-4ca4-ab3a-7705b09c8d8b"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:25:08.455602 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-9daeba84-e0ce-4673-8099-91e4d5606b66 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:25:08.456105 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-9daeba84-e0ce-4673-8099-91e4d5606b66 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] [instance: 6063ef32-6212-4feb-b3f1-4ec57a283a85] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:25:08.463245 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9daeba84-e0ce-4673-8099-91e4d5606b66 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:25:08.463826 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9daeba84-e0ce-4673-8099-91e4d5606b66 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:25:08.464737 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9daeba84-e0ce-4673-8099-91e4d5606b66 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:25:08.465383 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9daeba84-e0ce-4673-8099-91e4d5606b66 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:25:08.465610 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-8c2bec57-25ff-4973-86c6-26e0d873060c req-567d1394-e62e-450b-a8ce-b51ad5261c9a service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:25:08.466049 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-8c2bec57-25ff-4973-86c6-26e0d873060c req-567d1394-e62e-450b-a8ce-b51ad5261c9a service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:25:08.480249 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-8c2bec57-25ff-4973-86c6-26e0d873060c req-567d1394-e62e-450b-a8ce-b51ad5261c9a service nova] Creating event network-changed:d462e5dd-3dc2-4ca4-ab3a-7705b09c8d8b for instance 6063ef32-6212-4feb-b3f1-4ec57a283a85 on hv-cinder-84051 May 30 12:25:08.485706 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-8c2bec57-25ff-4973-86c6-26e0d873060c req-567d1394-e62e-450b-a8ce-b51ad5261c9a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040515 May 30 12:25:08.486288 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 542/1071] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:25:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:25:08.492747 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-9daeba84-e0ce-4673-8099-91e4d5606b66 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] [instance: 6063ef32-6212-4feb-b3f1-4ec57a283a85] Going to try to terminate instance {{(pid=117670) delete /opt/stack/nova/nova/compute/api.py:2664}} May 30 12:25:08.586590 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-9daeba84-e0ce-4673-8099-91e4d5606b66 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] 10.222.0.32 "DELETE /compute/v2.1/servers/6063ef32-6212-4feb-b3f1-4ec57a283a85" status: 204 len: 0 microversion: 2.1 time: 0.143636 May 30 12:25:08.587658 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 530/1072] 10.222.0.32 () {58 vars in 1238 bytes} [Mon May 30 12:25:08 2022] DELETE /compute/v2.1/servers/6063ef32-6212-4feb-b3f1-4ec57a283a85 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 30 12:25:08.598424 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-9fc576a6-dd90-418d-9b87-ad490d738633 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:25:08.600297 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-9fc576a6-dd90-418d-9b87-ad490d738633 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] [instance: 6063ef32-6212-4feb-b3f1-4ec57a283a85] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:25:08.610276 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9fc576a6-dd90-418d-9b87-ad490d738633 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:25:08.611075 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9fc576a6-dd90-418d-9b87-ad490d738633 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:25:08.611874 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9fc576a6-dd90-418d-9b87-ad490d738633 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:25:08.612238 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9fc576a6-dd90-418d-9b87-ad490d738633 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:25:08.749960 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-9fc576a6-dd90-418d-9b87-ad490d738633 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923af8dc0f1d4779bf388151093311f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143c400e4544c79955f901394c449f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:25:08.757641 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-9fc576a6-dd90-418d-9b87-ad490d738633 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] 10.222.0.32 "GET /compute/v2.1/servers/6063ef32-6212-4feb-b3f1-4ec57a283a85" status: 200 len: 1579 microversion: 2.1 time: 0.165236 May 30 12:25:08.758188 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 543/1073] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:25:08 2022] GET /compute/v2.1/servers/6063ef32-6212-4feb-b3f1-4ec57a283a85 => generated 1579 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:25:09.777334 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-25a4ca0c-a8d6-4b83-91ad-7c67da8db2c2 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:25:09.777955 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-25a4ca0c-a8d6-4b83-91ad-7c67da8db2c2 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] [instance: 6063ef32-6212-4feb-b3f1-4ec57a283a85] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:25:09.784430 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-25a4ca0c-a8d6-4b83-91ad-7c67da8db2c2 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:25:09.784885 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-25a4ca0c-a8d6-4b83-91ad-7c67da8db2c2 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:25:09.785653 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-25a4ca0c-a8d6-4b83-91ad-7c67da8db2c2 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:25:09.786090 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-25a4ca0c-a8d6-4b83-91ad-7c67da8db2c2 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:25:09.927152 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-25a4ca0c-a8d6-4b83-91ad-7c67da8db2c2 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923af8dc0f1d4779bf388151093311f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143c400e4544c79955f901394c449f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:25:09.934898 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-25a4ca0c-a8d6-4b83-91ad-7c67da8db2c2 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] 10.222.0.32 "GET /compute/v2.1/servers/6063ef32-6212-4feb-b3f1-4ec57a283a85" status: 200 len: 1579 microversion: 2.1 time: 0.162739 May 30 12:25:09.935472 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 531/1074] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:25:09 2022] GET /compute/v2.1/servers/6063ef32-6212-4feb-b3f1-4ec57a283a85 => generated 1579 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:25:10.818727 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-2768e80c-30e5-4628-a51b-d86b8d39787b req-13984805-bdde-4588-b300-66294c7ceae9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6063ef32-6212-4feb-b3f1-4ec57a283a85", "name": "network-vif-deleted", "tag": "d462e5dd-3dc2-4ca4-ab3a-7705b09c8d8b"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:25:10.827928 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-2768e80c-30e5-4628-a51b-d86b8d39787b req-13984805-bdde-4588-b300-66294c7ceae9 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:25:10.828398 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-2768e80c-30e5-4628-a51b-d86b8d39787b req-13984805-bdde-4588-b300-66294c7ceae9 service nova] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:25:10.844050 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-2768e80c-30e5-4628-a51b-d86b8d39787b req-13984805-bdde-4588-b300-66294c7ceae9 service nova] Creating event network-vif-deleted:d462e5dd-3dc2-4ca4-ab3a-7705b09c8d8b for instance 6063ef32-6212-4feb-b3f1-4ec57a283a85 on hv-cinder-84051 May 30 12:25:10.848765 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-2768e80c-30e5-4628-a51b-d86b8d39787b req-13984805-bdde-4588-b300-66294c7ceae9 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033682 May 30 12:25:10.849355 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 544/1075] 10.222.0.32 () {64 vars in 1317 bytes} [Mon May 30 12:25:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:25:10.953241 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-d62d0911-5c4c-4419-93e6-c5a0ba36bbac tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:25:10.953848 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-d62d0911-5c4c-4419-93e6-c5a0ba36bbac tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] [instance: 6063ef32-6212-4feb-b3f1-4ec57a283a85] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:25:10.961044 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d62d0911-5c4c-4419-93e6-c5a0ba36bbac tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:25:10.961524 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d62d0911-5c4c-4419-93e6-c5a0ba36bbac tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:25:10.962279 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d62d0911-5c4c-4419-93e6-c5a0ba36bbac tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:25:10.962713 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d62d0911-5c4c-4419-93e6-c5a0ba36bbac tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:25:11.025124 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-d62d0911-5c4c-4419-93e6-c5a0ba36bbac tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923af8dc0f1d4779bf388151093311f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143c400e4544c79955f901394c449f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:25:11.033255 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-d62d0911-5c4c-4419-93e6-c5a0ba36bbac tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] 10.222.0.32 "GET /compute/v2.1/servers/6063ef32-6212-4feb-b3f1-4ec57a283a85" status: 200 len: 1226 microversion: 2.1 time: 0.084215 May 30 12:25:11.037321 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 532/1076] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:25:10 2022] GET /compute/v2.1/servers/6063ef32-6212-4feb-b3f1-4ec57a283a85 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:25:12.051879 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-ba0778eb-1341-4a67-8fb1-507a3a55892c tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:25:12.052618 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-ba0778eb-1341-4a67-8fb1-507a3a55892c tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] [instance: 6063ef32-6212-4feb-b3f1-4ec57a283a85] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:25:12.059766 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ba0778eb-1341-4a67-8fb1-507a3a55892c tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:25:12.060235 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ba0778eb-1341-4a67-8fb1-507a3a55892c tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:25:12.061010 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ba0778eb-1341-4a67-8fb1-507a3a55892c tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:25:12.061466 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ba0778eb-1341-4a67-8fb1-507a3a55892c tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:25:12.074460 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.wsgi [None req-ba0778eb-1341-4a67-8fb1-507a3a55892c tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] HTTP exception thrown: Instance 6063ef32-6212-4feb-b3f1-4ec57a283a85 could not be found. May 30 12:25:12.076069 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-ba0778eb-1341-4a67-8fb1-507a3a55892c tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Request method failure captured: May 30 12:25:12.076069 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: request: GET /compute/v2.1/servers/6063ef32-6212-4feb-b3f1-4ec57a283a85 HTTP/1.1 May 30 12:25:12.076069 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Accept: application/json May 30 12:25:12.076069 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Accept-Encoding: identity May 30 12:25:12.076069 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Connection: close May 30 12:25:12.076069 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Content-Length: 0 May 30 12:25:12.076069 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Content-Type: application/json May 30 12:25:12.076069 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Host: 10.222.0.32 May 30 12:25:12.076069 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Openstack-System-Scope: None May 30 12:25:12.076069 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: User-Agent: python-urllib3/1.26.9 May 30 12:25:12.076069 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Auth-Token: gAAAAABilLYJ8yD9zjHsgwVNhwmlOc84aR0-ls_eOuOFz5m7ew82a65Im6Z5tPXeZEvIgPz3JSvQMJIX4Ds_E74k3HnvajayX0QYGJEXNA8CQ6dAp-eAWEOPynREKg7GvzXvPpjW-8GWPRYhWLBp871ZPukmRxEicEgMhPRbwUt9L1aDIsLcjZY May 30 12:25:12.076069 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Domain-Id: None May 30 12:25:12.076069 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Domain-Name: None May 30 12:25:12.076069 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Identity-Status: Confirmed May 30 12:25:12.076069 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Is-Admin-Project: True May 30 12:25:12.076069 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Domain-Id: default May 30 12:25:12.076069 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Domain-Name: Default May 30 12:25:12.076069 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Id: 5143c400e4544c79955f901394c449f6 May 30 12:25:12.076069 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Name: tempest-TestVolumeBootPattern-1287587269 May 30 12:25:12.076069 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Role: reader,member May 30 12:25:12.076069 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Roles: reader,member May 30 12:25:12.077617 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/5143c400e4544c79955f901394c449f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/5143c400e4544c79955f901394c449f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/5143c400e4544c79955f901394c449f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_5143c400e4544c79955f901394c449f6", "adminURL": "http://10.222.0.32:8080"}]}] May 30 12:25:12.077617 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Tenant: tempest-TestVolumeBootPattern-1287587269 May 30 12:25:12.077617 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Tenant-Id: 5143c400e4544c79955f901394c449f6 May 30 12:25:12.077617 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Tenant-Name: tempest-TestVolumeBootPattern-1287587269 May 30 12:25:12.077617 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User: tempest-TestVolumeBootPattern-1287587269-project May 30 12:25:12.077617 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Domain-Id: default May 30 12:25:12.077617 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Domain-Name: Default May 30 12:25:12.077617 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Id: 923af8dc0f1d4779bf388151093311f6 May 30 12:25:12.077617 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Name: tempest-TestVolumeBootPattern-1287587269-project May 30 12:25:12.077617 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: method: > May 30 12:25:12.077617 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: exception: Instance 6063ef32-6212-4feb-b3f1-4ec57a283a85 could not be found. May 30 12:25:12.077617 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: action_args: {'id': '6063ef32-6212-4feb-b3f1-4ec57a283a85'} May 30 12:25:12.078459 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:25:12.078459 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:25:12.078459 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:25:12.078459 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:25:12.078459 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:25:12.078459 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:25:12.078459 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:25:12.078459 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:25:12.078459 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:25:12.078459 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:25:12.078459 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6063ef32-6212-4feb-b3f1-4ec57a283a85 could not be found. May 30 12:25:12.078459 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:25:12.078459 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:25:12.078459 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:25:12.078459 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:25:12.078459 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:25:12.078459 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:25:12.078459 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:25:12.078459 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:25:12.078459 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:25:12.080015 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:25:12.080015 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 30 12:25:12.080015 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 30 12:25:12.080015 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 30 12:25:12.080015 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 30 12:25:12.080015 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:25:12.080015 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:25:12.080015 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6063ef32-6212-4feb-b3f1-4ec57a283a85 could not be found. May 30 12:25:12.080015 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:25:12.080015 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:25:12.080015 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:25:12.080015 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:25:12.080015 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:25:12.080015 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:25:12.080015 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:25:12.080015 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:25:12.080015 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6063ef32-6212-4feb-b3f1-4ec57a283a85 could not be found. May 30 12:25:12.080015 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:25:12.081473 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-ba0778eb-1341-4a67-8fb1-507a3a55892c tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Returning 404 to user: Instance 6063ef32-6212-4feb-b3f1-4ec57a283a85 could not be found. {{(pid=117671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:25:12.081473 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-ba0778eb-1341-4a67-8fb1-507a3a55892c tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] 10.222.0.32 "GET /compute/v2.1/servers/6063ef32-6212-4feb-b3f1-4ec57a283a85" status: 404 len: 111 microversion: 2.1 time: 0.030492 May 30 12:25:12.081473 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 545/1077] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:25:12 2022] GET /compute/v2.1/servers/6063ef32-6212-4feb-b3f1-4ec57a283a85 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 30 12:25:12.519244 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-7eb71a92-4db1-4871-bc17-8b718ace8011 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:25:12.519795 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-7eb71a92-4db1-4871-bc17-8b718ace8011 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] [instance: 0a940b67-afa3-4dbd-b665-bff213c051c3] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:25:12.527336 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7eb71a92-4db1-4871-bc17-8b718ace8011 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:25:12.527792 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7eb71a92-4db1-4871-bc17-8b718ace8011 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:25:12.528596 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7eb71a92-4db1-4871-bc17-8b718ace8011 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:25:12.529030 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7eb71a92-4db1-4871-bc17-8b718ace8011 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:25:12.543314 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.wsgi [None req-7eb71a92-4db1-4871-bc17-8b718ace8011 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] HTTP exception thrown: Instance 0a940b67-afa3-4dbd-b665-bff213c051c3 could not be found. May 30 12:25:12.544980 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-7eb71a92-4db1-4871-bc17-8b718ace8011 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Request method failure captured: May 30 12:25:12.544980 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: request: DELETE /compute/v2.1/servers/0a940b67-afa3-4dbd-b665-bff213c051c3 HTTP/1.1 May 30 12:25:12.544980 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Accept: application/json May 30 12:25:12.544980 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Accept-Encoding: identity May 30 12:25:12.544980 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Connection: close May 30 12:25:12.544980 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Content-Length: 0 May 30 12:25:12.544980 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Content-Type: application/json May 30 12:25:12.544980 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Host: 10.222.0.32 May 30 12:25:12.544980 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Openstack-System-Scope: None May 30 12:25:12.544980 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: User-Agent: python-urllib3/1.26.9 May 30 12:25:12.544980 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Auth-Token: gAAAAABilLYJ8yD9zjHsgwVNhwmlOc84aR0-ls_eOuOFz5m7ew82a65Im6Z5tPXeZEvIgPz3JSvQMJIX4Ds_E74k3HnvajayX0QYGJEXNA8CQ6dAp-eAWEOPynREKg7GvzXvPpjW-8GWPRYhWLBp871ZPukmRxEicEgMhPRbwUt9L1aDIsLcjZY May 30 12:25:12.544980 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Domain-Id: None May 30 12:25:12.544980 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Domain-Name: None May 30 12:25:12.544980 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Identity-Status: Confirmed May 30 12:25:12.544980 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Is-Admin-Project: True May 30 12:25:12.544980 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Domain-Id: default May 30 12:25:12.544980 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Domain-Name: Default May 30 12:25:12.544980 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Id: 5143c400e4544c79955f901394c449f6 May 30 12:25:12.544980 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Project-Name: tempest-TestVolumeBootPattern-1287587269 May 30 12:25:12.544980 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Role: reader,member May 30 12:25:12.544980 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Roles: reader,member May 30 12:25:12.546618 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/5143c400e4544c79955f901394c449f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/5143c400e4544c79955f901394c449f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/5143c400e4544c79955f901394c449f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_5143c400e4544c79955f901394c449f6", "adminURL": "http://10.222.0.32:8080"}]}] May 30 12:25:12.546618 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant: tempest-TestVolumeBootPattern-1287587269 May 30 12:25:12.546618 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant-Id: 5143c400e4544c79955f901394c449f6 May 30 12:25:12.546618 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-Tenant-Name: tempest-TestVolumeBootPattern-1287587269 May 30 12:25:12.546618 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User: tempest-TestVolumeBootPattern-1287587269-project May 30 12:25:12.546618 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Domain-Id: default May 30 12:25:12.546618 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Domain-Name: Default May 30 12:25:12.546618 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Id: 923af8dc0f1d4779bf388151093311f6 May 30 12:25:12.546618 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: X-User-Name: tempest-TestVolumeBootPattern-1287587269-project May 30 12:25:12.546618 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: method: > May 30 12:25:12.546618 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: exception: Instance 0a940b67-afa3-4dbd-b665-bff213c051c3 could not be found. May 30 12:25:12.546618 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: action_args: {'id': '0a940b67-afa3-4dbd-b665-bff213c051c3'} May 30 12:25:12.547616 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:25:12.547616 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:25:12.547616 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:25:12.547616 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:25:12.547616 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:25:12.547616 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:25:12.547616 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:25:12.547616 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:25:12.547616 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:25:12.547616 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:25:12.547616 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a940b67-afa3-4dbd-b665-bff213c051c3 could not be found. May 30 12:25:12.547616 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:25:12.547616 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:25:12.547616 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:25:12.547616 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:25:12.547616 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:25:12.547616 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:25:12.547616 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:25:12.547616 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:25:12.547616 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:25:12.549841 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:25:12.549841 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 30 12:25:12.549841 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 30 12:25:12.549841 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 30 12:25:12.549841 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 30 12:25:12.549841 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 30 12:25:12.549841 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 30 12:25:12.549841 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:25:12.549841 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:25:12.549841 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a940b67-afa3-4dbd-b665-bff213c051c3 could not be found. May 30 12:25:12.549841 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:25:12.549841 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:25:12.549841 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:25:12.549841 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:25:12.549841 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:25:12.549841 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:25:12.549841 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:25:12.549841 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:25:12.549841 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a940b67-afa3-4dbd-b665-bff213c051c3 could not be found. May 30 12:25:12.549841 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi May 30 12:25:12.552734 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-7eb71a92-4db1-4871-bc17-8b718ace8011 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Returning 404 to user: Instance 0a940b67-afa3-4dbd-b665-bff213c051c3 could not be found. {{(pid=117670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:25:12.552734 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-7eb71a92-4db1-4871-bc17-8b718ace8011 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] 10.222.0.32 "DELETE /compute/v2.1/servers/0a940b67-afa3-4dbd-b665-bff213c051c3" status: 404 len: 111 microversion: 2.1 time: 0.031187 May 30 12:25:12.552734 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 533/1078] 10.222.0.32 () {58 vars in 1238 bytes} [Mon May 30 12:25:12 2022] DELETE /compute/v2.1/servers/0a940b67-afa3-4dbd-b665-bff213c051c3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 30 12:25:12.554942 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-ba0b14c6-6e90-4d77-b7f1-496144c5e606 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:25:12.555550 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-ba0b14c6-6e90-4d77-b7f1-496144c5e606 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] [instance: 0a940b67-afa3-4dbd-b665-bff213c051c3] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:25:12.561707 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ba0b14c6-6e90-4d77-b7f1-496144c5e606 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:25:12.562154 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ba0b14c6-6e90-4d77-b7f1-496144c5e606 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:25:12.562914 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ba0b14c6-6e90-4d77-b7f1-496144c5e606 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:25:12.563349 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ba0b14c6-6e90-4d77-b7f1-496144c5e606 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Lock "aeb16e79-014c-4213-8687-12281f6933dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:25:12.576648 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.wsgi [None req-ba0b14c6-6e90-4d77-b7f1-496144c5e606 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] HTTP exception thrown: Instance 0a940b67-afa3-4dbd-b665-bff213c051c3 could not be found. May 30 12:25:12.578168 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-ba0b14c6-6e90-4d77-b7f1-496144c5e606 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Request method failure captured: May 30 12:25:12.578168 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: request: GET /compute/v2.1/servers/0a940b67-afa3-4dbd-b665-bff213c051c3 HTTP/1.1 May 30 12:25:12.578168 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Accept: application/json May 30 12:25:12.578168 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Accept-Encoding: identity May 30 12:25:12.578168 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Connection: close May 30 12:25:12.578168 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Content-Length: 0 May 30 12:25:12.578168 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Content-Type: application/json May 30 12:25:12.578168 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Host: 10.222.0.32 May 30 12:25:12.578168 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Openstack-System-Scope: None May 30 12:25:12.578168 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: User-Agent: python-urllib3/1.26.9 May 30 12:25:12.578168 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Auth-Token: gAAAAABilLYJ8yD9zjHsgwVNhwmlOc84aR0-ls_eOuOFz5m7ew82a65Im6Z5tPXeZEvIgPz3JSvQMJIX4Ds_E74k3HnvajayX0QYGJEXNA8CQ6dAp-eAWEOPynREKg7GvzXvPpjW-8GWPRYhWLBp871ZPukmRxEicEgMhPRbwUt9L1aDIsLcjZY May 30 12:25:12.578168 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Domain-Id: None May 30 12:25:12.578168 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Domain-Name: None May 30 12:25:12.578168 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Identity-Status: Confirmed May 30 12:25:12.578168 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Is-Admin-Project: True May 30 12:25:12.578168 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Domain-Id: default May 30 12:25:12.578168 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Domain-Name: Default May 30 12:25:12.578168 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Id: 5143c400e4544c79955f901394c449f6 May 30 12:25:12.578168 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Project-Name: tempest-TestVolumeBootPattern-1287587269 May 30 12:25:12.578168 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Role: reader,member May 30 12:25:12.578168 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Roles: reader,member May 30 12:25:12.579908 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/5143c400e4544c79955f901394c449f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/5143c400e4544c79955f901394c449f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/5143c400e4544c79955f901394c449f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_5143c400e4544c79955f901394c449f6", "adminURL": "http://10.222.0.32:8080"}]}] May 30 12:25:12.579908 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Tenant: tempest-TestVolumeBootPattern-1287587269 May 30 12:25:12.579908 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Tenant-Id: 5143c400e4544c79955f901394c449f6 May 30 12:25:12.579908 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-Tenant-Name: tempest-TestVolumeBootPattern-1287587269 May 30 12:25:12.579908 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User: tempest-TestVolumeBootPattern-1287587269-project May 30 12:25:12.579908 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Domain-Id: default May 30 12:25:12.579908 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Domain-Name: Default May 30 12:25:12.579908 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Id: 923af8dc0f1d4779bf388151093311f6 May 30 12:25:12.579908 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: X-User-Name: tempest-TestVolumeBootPattern-1287587269-project May 30 12:25:12.579908 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: method: > May 30 12:25:12.579908 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: exception: Instance 0a940b67-afa3-4dbd-b665-bff213c051c3 could not be found. May 30 12:25:12.579908 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: action_args: {'id': '0a940b67-afa3-4dbd-b665-bff213c051c3'} May 30 12:25:12.581006 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:25:12.581006 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:25:12.581006 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:25:12.581006 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:25:12.581006 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:25:12.581006 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:25:12.581006 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:25:12.581006 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:25:12.581006 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:25:12.581006 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:25:12.581006 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a940b67-afa3-4dbd-b665-bff213c051c3 could not be found. May 30 12:25:12.581006 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:25:12.581006 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:25:12.581006 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:25:12.581006 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:25:12.581006 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:25:12.581006 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:25:12.581006 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:25:12.581006 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:25:12.581006 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:25:12.582616 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:25:12.582616 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 30 12:25:12.582616 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 30 12:25:12.582616 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 30 12:25:12.582616 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 30 12:25:12.582616 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:25:12.582616 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:25:12.582616 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a940b67-afa3-4dbd-b665-bff213c051c3 could not be found. May 30 12:25:12.582616 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:25:12.582616 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:25:12.582616 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:25:12.582616 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:25:12.582616 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:25:12.582616 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:25:12.582616 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:25:12.582616 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:25:12.582616 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a940b67-afa3-4dbd-b665-bff213c051c3 could not be found. May 30 12:25:12.582616 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi May 30 12:25:12.584295 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-ba0b14c6-6e90-4d77-b7f1-496144c5e606 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Returning 404 to user: Instance 0a940b67-afa3-4dbd-b665-bff213c051c3 could not be found. {{(pid=117671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:25:12.584295 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-ba0b14c6-6e90-4d77-b7f1-496144c5e606 tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] 10.222.0.32 "GET /compute/v2.1/servers/0a940b67-afa3-4dbd-b665-bff213c051c3" status: 404 len: 111 microversion: 2.1 time: 0.028496 May 30 12:25:12.584295 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 546/1079] 10.222.0.32 () {58 vars in 1235 bytes} [Mon May 30 12:25:12 2022] GET /compute/v2.1/servers/0a940b67-afa3-4dbd-b665-bff213c051c3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 30 12:25:13.873998 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-16ebac85-521f-4dfc-98e4-b9200b2019fe tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] Calling method '.version_select at 0x7f0ef8953430>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:25:13.904757 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-16ebac85-521f-4dfc-98e4-b9200b2019fe tempest-TestVolumeBootPattern-1287587269 tempest-TestVolumeBootPattern-1287587269-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1330641870" status: 202 len: 0 microversion: 2.1 time: 0.036125 May 30 12:25:13.905648 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 534/1080] 10.222.0.32 () {58 vars in 1262 bytes} [Mon May 30 12:25:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1330641870 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 30 12:26:03.661875 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 30 12:26:03.662515 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Mon May 30 12:26:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 30 12:27:31.688800 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 30 12:27:31.689377 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Mon May 30 12:27:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 30 12:27:45.514101 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 30 12:27:45.515114 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Mon May 30 12:27:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 30 12:28:05.078796 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 30 12:28:05.079654 dv-cinder-840512-2-iscsi devstack@n-api.service[117671]: Mon May 30 12:28:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 30 12:29:23.670471 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 30 12:29:23.671115 dv-cinder-840512-2-iscsi devstack@n-api.service[117670]: Mon May 30 12:29:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!